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ANALYSIS OF THE INDIVIDUAL 


Editorial Overview 


DONALD G 


T= NOC program includes the 
analysis of the individual as an 
essential element in the occupa- 
tional adjustment of youth and adults. 
In keeping with this objective, this issue 
of Occupations is devoted to a series of 
twelve articles in which twelve psy- 
chologists attempt to portray, from one 
angle or another, the extent to which vo- 
cational psychology is now prepared to 
aid in this phase of the work. 

In presenting these articles as a sort of 
symposium, it should be clearly under- 
stood that no attempt has been made to 
explore and exhibit a complete, system- 
atic treatise on the present status of vo- 
cational psychology. Rather, the aim has 
been to persuade.a group of busy, work- 
ing psychologists to put down on paper 
some of the things they believe the busy, 
working counselor would like to know 
about present-day ways and means of 
analyzing the individual. 

A glance at the table of contents re- 
veals a rich variety of topics. In general, 
one might divide the subjects into two 
groups: those which deal with practical 
applications of psychological techniques 
in typical guidance situations and those 
which tend to emphasize the theoretical 
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and scientific aspects of research method- 
ology. In the long run, of course, im- 
provement in practical applications de- 
pends upon progress in theoretical re- 
search. It is futile, however, to make 
such distinctions because the history of 
pure and applied science abundantly re- 
veals the interdependence of theory and 
practice. 
II 

“The Major Strategy of Guidance’ has 
been placed first, because it so clearly and 
forcefully challenges traditional mass edu- 
cation by pointing out that the philosophy 
of guidance must permeate the entire 
educational system if guidance techniques 
now available are to be put into 
effective operation. Thus, the ground 
having been cleared of opposition to the 
application of guidance techniques, Craw- 
ford ushers the reader behind the scenes 
and shows how the technicians are forg- 
ing better measurement tools as research 
discloses the weaknesses of existing tech- 
niques. The reader who happens to have 
been over-sold on available psychological 
tests will certainly be shocked by Craw- 
ford’s polemic. On the other hand, the 
reader who happens to be a confirmed 
skeptic in regard to this business of tests 
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and measurements will undoubtedly be 
elated. But both types of readers should 
re-read the last sentence of Crawford's 
second paragraph—"'Sound tests do exist 
and furnish valuable evidence, not other- 
wise obtainable, for guidance.” 

The article by Toops presents a com- 
prehensive state-wide guidance program. 
Visionary, impractical, and too idealistic? 
Yes, if one clings to the educational phil- 
osophy of “the good old days.’” No, if 
one closely follows the trends of today 
which will become the practice of tomor- 
row. And then O’Rourke moves us along 
from a state-wide program to a national 
program in which government, education, 
and industry collaborate in the develop- 
ment of selective techniques and stand- 
ards. Here is one answer to the persistent 
demand that educators should get a better 
knowledge of the world of industry and 
that industrialists should seek a better 
understanding of education. In other 
words, cooperative research of this type 
will contribute importantly in the direc- 
tion of mutual knowledge and under- 
standing. 

It is a natural transition to go from 
the individual profile charts contained in 
O'Rourke's article to the graphic profile 
charts presented by Trabue as a means of 
portraying the pattern of traits which 
characterizes successful workers in par- 
ticular occupations. This by-product of 
the Minnesota Employment Stabilization 
Research Institute is no new discovery nor 
is it any novel device—it is our old friend 
the Vocational Psychograph as described 
by Hollingworth in his pioneer book on 
Vocational Psychology written in 1916. 
It is significant that this device is being 
used by the National Institute of Indus- 
trial Psychology in England as well as in 
the vocational guidance work being 
undertaken on the other side of the world 
in Australia. But the term, Occupational 


Ability Pattern, has caught the fancy of 
many people, and it is well to have the 
dangers of misuse pointed out by Hop- 
pock in his engagingly critical manner. 

The reader is now privileged to take 
a look or perchance to take another look 
at the promising though somewhat for- 
midable device known as Strong’s Vo- 
cational Interest Test. Those who are 
likely to become shell-shocked when 
placed in the vicinity of those dreaded 
coefficients of correlation are warned in 
advance. And those who have become 
habituated to such harmless things are 
also warned because, in addition to sim- 
ple coefficients of correlation, one is 
brought face to face with multiple factor 
analysis which goes outside three-dimen- 
sional space and plunges into the realm 
of five-dimensional space. But survivors 
of these mathematical pitfalls will value 
the discussion because of the significant 
data regarding interests as measured by 


the Strong Test. 

Since Strong’s article includes an exam- 
ple of multiple factor analysis, the reader 
will be prepared for Thorndike’s discus- 
sion of “Unity or Purity in Traits and 


Tests.” The Committee on Unitary 
Traits, of which Thorndike is chairman, 
is carrying on fundamental research of 
great theoretical importance which may 
lead to revolutionary changes in the psy- 
chological tests and measurements of to- 
morrow. No counselor who is aware of 
these pioneering inquiries will dare be- 
come satisfied or completely dependent 
upon existing instruments of psychologi- 
cal diagnosis. 

The articles by Kitson and Hull are 
designed to disclose the techniques in- 
volved in developing vocational aptitude 
tests. Here we see the elaborate method- 
ology which should be employed in the 
development of vocational selection and 
vocational guidance tests. 
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And finally the articles by Earle and 
Alexander provide a close-up of British 
thought and action. Earle, formerly head 
of the vocational guidance work of the 
National Institute of Industrial Psycholo- 
gy, describes the significant elements in- 
volved in a psychological approach to 
the vital problem of diagnosing the indi- 
vidual. Alexander, on the other hand, 
surveys the field of psychological research 
in Great Britain and America. He at- 
tempts to synthesize various approaches, 
and finally formulates a comprehensive 
research program which, if carried out, 
would undoubtedly facilitate progress 
in the field of vocational guidance. 
Especially noteworthy is Alexander's in- 
sistence that the three aspects of guidance 
—individual analysis, occupational analy- 
sis, and guidance techniques—should be 
integrated in a unified approach employ- 
ing the same set of terms. This thought- 
provoking survey and forward-looking 
plan of research action is placed last in 


the series of articles because it so ad- 
equately surveys the present and so sharp- 
ly directs attention to the immediate 


future. 
Il 

Progress in science does not come 
through censorship and forced regimenta- 
tion of ideas. Hence, the “guest editor” 
of this issue has used no blue pencil in 
preparing these papers for the printer. 
Differences in point of view and even 
contradictory statements of fact are ap- 
parent in the several contributions. These 
are healthy signs of a lively interest, and 
of vigorous activity on the part of voca- 
tional psychologists. 

Thus the working counselor on the 
firing line can be assured of increasing 
support by those whose business it is to 
provide some of the weapons of attack 
and to supplement these by increased 
knowledge of their possibilities and limi- 
tations. 


Cro 


DONALD G. PATERSON (“Analysis of the 
Individual”) is Professor of Psychology, 
University of Minnesota, and Secretary of 
the American Psychological Association. 
He headed the work in Individual Analysis 
and Re-training done by the Minnesota Em- 
ployment Stabilization Research Institute. 
He is author of Physique and Intellect and 
other books, and co-author of the widely 


used Pintner-Paterson Scale for measuring 
performance. Professor Paterson served as 
special editor of this issue of Occupations, 
the Vocational Guidance Magazine, and his 
efforts made possible the presentation of the 
articles included in it—a service, we believe, 
to all guidance workers. He is chairman of 
the Technical Committee of the National 
Occupational Conference. 


ANALYSIS OF OCCUPATIONS 
Under this general title a symposium edited by Morris S. Viteles will 
appear in the June issue of Occupations, the Vocational Guidance Maga- 
zine. This will be a companion issue to the present one on “Analysis 


of the Individual.” 
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HEN insulin was perfected, the 
discovery did not come like a bolt 
out of the blue. For years a great 


many facts had been established about the 
function of the tissues now known as the 
islets of Langerhans and about the func- 
tion of certain other tissues known as 
acinar cells. But a great physiologist had 
with authority pronounced the islets to be 
merely exhausted cells of the acinar va- 
riety, whereas they are in reality highly 
important for sugar metabolism. Most 
research workers in physiology and medi- 
cine accepted the fiat; and it is probably 
fair to say that, in consequence, the dis- 
covery of insulin was retarded by at least 
twenty years. 

A similar pathetic fallacy bids fair to 
prevail in the field of educational and vo- 
cational guidance. Counselors and experts 
in guidance have long known that voca- 
tional guidance is essentially educational 
guidance; and guidance along educational 
lines is seriously crippled if not actually 
helpless in the face of regimented and 
stereotyped curricula. What, for exam- 
ple, would have been the fate of the 
Wright brothers if they had been born 25 
years later, had been collared by the tru- 
ant officer, and had been forced to leave 
their bicycle shop for rigorous training in 
spelling, arithmetic, and community civ- 
ics? It is hardly necessary to enlarge 
upon the implications. 

The techniques of guidance have long 
been known to every experienced coun- 
selor. While they have by no means 
reached a state of perfection, they are 


nevertheless practical and highly valuable 
if there is opportunity to apply them. 
The most adequate description of these 
techniques is outlined in connection with 
the cumulative educational record form 
of the American Council on Education.’ 
The educational record form is arranged 
to give a compact, sequential sketch of 
the pupil’s school and social history for a 
six-year period. Three such forms would 
cover the elementary, high school, and 
college career of a boy or girl. When 
filled out, they present a time-projection 
of high points in the child’s life. The 
most prominent feature of this record is 
its vertical columns which, from left to 
right, represent successive calendar years 
subdivided by light lines into calendar 
quarters. In the left margin are the 
rubrics, so that a given kind of informa- 
tion is always found on a given line; and 
the date of the observation, measurement, 
or event is indicated by the column in 
which it is recorded. Thus, it is possible 
to secure a bird’s-eye view of the child's 
recorded life in any one year by reading 
the column for that year; and it is pos- 
sible to follow the child’s development by 
reading all the entries in a given line 
from left to right. 

Essentially a graph, this form is con- 
venient both for recording and for or- 
ganizing and interpreting information 
from varied sources. But the record it- 
self does not illustrate fully one type of 


1 Educational Record Supplement (1928). Copies 
may be secured from the American Council on 
Education, 744 Jackson Place, Washington, D. C. 
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information which the committee urged 
as mecessafy in its original report,’ 
namely, the description of the child’s 
conduct and personality by means of fre- 
quent brief reports from the teacher— 
concrete observations on the personal de- 
velopment of the pupil. In the few 
schools where guidance has become an art 
much time is given to observing the be- 
havior of pupils; events are recorded in 
the form of anecdotes and are analyzed 
and interpreted periodically. This pro- 
cedure is useful, along with the data 
from comparable achievement tests,* for 
long-term guidance where tentative goals 
are set up and are progressively modi- 
fied. 
II 

Despite fairly scientific knowledge re- 
garding the tools of guidance, counselors 
have failed dismally to reach their goals. 
They have laid themselves open unwit- 
tingly to the strictures brought down on 
their heads by the blunders of intemper- 
ate zealots. To an unthinkable degree 
guidance experts are so exclusively ab- 
sorbed in the technical minutiae of their 
craft—in the refinement of tests, in the 
niceties of statistical analysis, in the fly- 
by-year interviews forced by circum- 
stances—that they have ignored the fact 
that guidance lies at the very taproot of 
education, that perspective must be de- 
veloped in the administrators and cur- 
ticulum-makers who dominate our 
schools, that guidance is a philosophy not 
a dull bookkeeping. Not only must the 
administrator be induced to forget his 
notions about what the child ought to 
know, but the teacher must learn to place 


2 Educational Record Supplement (1928). 
Pages 53-64. 

8 Basic Comsiderations in Educational Testing. 
By Ben D. Wood. With list of tests. Reprints on 
request to Committee on Educational Testing, 
University of Minnesota, Minneapolis, Minn. 


{9] 


the welfare of the pupil above depart- 
mental loyalty. School objectives have no 
validity except as they are compatible 
with the needs of the child who must be 
rediscovered as an individual. 

While the counselors are buried in 
technical detail, our teacher-training in- 
stitutions continue to pour out admin- 
istrators, curriculum-makers, and class- 
room tacticians. These graduates are zeal- 
ous to administer, to make curricula and 
to teach, but oblivious to their highest 
duty of searching out and meeting the 
needs of growing children, whether they 
be geniuses, mediocrities, or morons. If 
the experience of the last decade has 
shown anything, it is this: Unless the 
great majority of teachers become guid- 
ance-minded, nothing can save us from 
our administrators and from our subject- 
matter-bound tacticians. 

From the viewpoint both of society 
and of the individual it is obviously more 
important what kind of social being a 
pupil becomes than what prescribed 
courses he passes. Administrators have 
tried to attain ‘the objectives of the 
school” with mass prescriptions called 
curricula and standards, and by enforcing 
these prescriptions with all the direct and 
indirect means of coercion available 
within the law. The traditional apology 
for the a priori curriculum is that chil- 
dren must be socialized. But this defense 
has never clarified how the flunkers (10 
to 40 per cent) are socialized, nor how 
the great majority of those who pass are 
socialized if they never have occasion in 
later life to use their gleanings from 
such courses. 

Experience has shown that many of 
the prescribed courses are beyond the in- 
tellectual capacity of large fractions of the 
school population, alien to the interests of 
a larger fraction, and irrelevant to the 
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life needs of a still larger fraction. Can- 
dor compels us to observe that, however 
valuable, not to say glorious, some subject 
matters have been and will continue to 
be, such subjects could hardly have sur- 
vived as universal requirements except 
for departmental loyalties, highly organ- 
ized academic log-rolling, and _ social 
inertia. 
Ill 

The foregoing facts and points of view 
have long been known to experts in guid- 
ance, and most counselors have long- 
standing sympathy for the dean of men 
who said to a student: “If you want an 
education you should take the program 
you have outlined; if you want a degree 
you must take these required courses, 
which are admittedly irrelevant to your 
purposes; but you cannot get both an edu- 
cation and a degree from this college.” 
The dean had recognized the hopeless in- 
compatibility of significant educational 
guidance as a philosophy and the hum- 
drum digging that marks the pursuit of a 
degree. 

Guidance is a philosophy! But it can- 
not realize its full potentialities until (1) 
a greater share of the educational budget 
is allotted to its functions, and (2) a ma- 
jority of administrators and teachers ac- 
knowledge, with both mind and heart, 
that the welfare of the child is more im- 
portant than departmental loyalty and 
curricular pattern. These two changes 
cannot be made by purely technical ad- 
vances. The guidance leaders must turn 
their attention to the administrative, 
financial, teacher-training, and curric- 
ulum-making agencies in our schools, as 
well as continue their work of technical 
research and self-education. Self-educa- 
tion is essential, but insufficient. It is 
only too obvious that constructive, sys- 
tematic, long-term guidance cannot be- 


come a reality unless active and hearty co 
operation of the majority of school of- 
ficers and teachers replaces their present 
attitude, which is frequently one of active 
opposition, and is almost never better 
than indifferent tolerance based on lack 
of understanding. In other words, one 
of the indispensable prerequisites to 
guidance potentialities is to convert Pro- 
fessor Morrison's exhortation into act- 
uality: “Teachers (should) spend half 
their time studying their pupils as indi- 
viduals, and the rest of their time doing 
what that study shows to be desirable and 
necessary.’ 

This re-orientation of teachers and 
school officers cannot be accomplished by 
the teacher-training institutions alone, for 
at least two reasons. First, the majority 
of these institutions are themselves ap- 
parently committed to the prescriptive 
curriculum as an administrative and 
financial necessity, if not to a disciplinary 
and compulsive theory of education. Sec- 
ond, only a fraction of the teachers now 
in service can expose themselves to the 
direct influence of the teacher-training in- 
stitutions. The immediate need, there- 
fore, is the double one of discovering 
some effective way of re-orienting teach- 
efs in service, and of giving guidance a 
sound philosophical, administrative, and 
financial foundation in our teacher-train- 
ing institutions. To be effective, guid- 
ance must become, at least in its funda- 
mental philosophy and broad adminis- 
trative implications, the corner-stone of 
the professional education of teachers 
rather than a technical specialty to which 
only a small fraction of teachers in train- 
ing (prospective advisers, deans of stu- 
dents, etc.) are normally exposed. 
Orientation toward guidance as a philos- 
ophy must come from within; and if it is 
not encouraged by counselors and tech- 
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nicians themselves, hope must become 
progressively attenuated and tangential. 
Broad curricular outlines and descrip- 
tions of desirable objectives have their 
value, of course, not as specific goals to 
be sought, or as standards to be enforced 
at any cost, but as general guides for the 
ultimate curriculum-maker, namely, the 
teacher who comes into daily contact with 
the individual pupil. In the ideal school 
curriculum-making will become a process 
of formulating individual goals and of 
modifying them progressively in accord 
with the developing capacities, interests, 
and needs of individual pupils. This 
process will be a continuous cycle of: (1) 
learning the capacities, interests, and 
needs of individual children; (2) setting 
up provisional goals, academic, vocational 
and professional; (3) getting the student 
to consider those goals at least pro- 
visionally; (4) helping the student to at- 
tain those goals by teaching when neces- 
sary, or by refraining from teaching when 
possible; (5) studying the progress made, 
with a readiness to modify the goals if 
necessary. The indispensable instru- 
mentality for this process is the cumula- 
tive record of comparable measures, per- 
sonal and social data, and teachers’ ob- 
servations, such as that recommended by 
the American Council on Education. 
This new approach to the whole life 
and substance of education, this expan- 
sion of a technique into a philosophy, this 
rediscovery of the child as an individual 
is something to give one pause. And 
though the reluctance of the craftsmen to 
undertake the task is, perhaps, a real 
tribute to their modesty, failure to meet 
the obligation would be nothing short of 
genuine tragedy. It is not heartening to 
contemplate the magnitude of the under- 
taking, nor the travail of a revolution in 
educational thinking. But even more dis- 
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heartening is the danger that in the future 
education may become still more acutely 
and still more ingloriously regimented. 


IV 


Modest though it may seem, one of the 
most hopeful, self-perpetuating attacks 
on the problem arises out of the individ- 
ual case study.* Most teachers are gen- 
uinely interested in the children com- 
mitted to their care; and most adminis- 
trators likewise. What, then, could be 
more fitting than that the philosophy of 
guidance be brought home concretely to 
these teachers and administrators? A 
single case, well-selected and well-docu- 
mented, is a more powerful instrument 
than volumes of the most recondite ex- 
position, or the cold and lengthy elo- 
quence of extensive investigation. 

The simplest procedure is to select a 
child, any child, in whom some teacher 
has shown an interest, and then, in the 
absence of cumulative data, make a cross- 
section or horizontal study, using achieve- 
ment tests, aptitude tests, and the like. A 
modest diagram may then be drawn in 
the form of a circle with radii sufficient 
in number to represent each variable. 
These radii may then be calibrated in per- 
centile or sigma units and the child’s 
scores plotted at the appropriate intervals. 
The points having been connected by 
lines, the resulting figure is almost cer- 
tain to shed new light upon the child as 
an individual whose deviation from any 
standard or ideal is a fact to be faced 
educationally. 

If in addition the counselor has avail- 
able anecdotal material, such as referred 
to above, and various ratings such as 
those from Strong’s Vocational Interest 
Blank, so much the better. It is but a 


4 Vocational Counseling at the University of 
Minnesota. By E. G. Williamson. Reprints on 
request. 








single step from this point to direct ques- 
tioning of the teacher—should all the ma- 
chinery and impedimenta of education be 
brought to bear upon the child in an ef- 
fort to iron out his deviations from the 
norm? Or, in some measure at least, 
should his outstanding traits be encour- 
aged and his weaker ones ignored, or at 
any rate not dinned into his consciousness 
as shortcomings which must at any cost 
be brought up to scratch? 

Individuation as an end in itself may, 
of course, be carried to an unfortunate 
extreme. And teachers or others may 
even entertain just doubts lest over- 
emphasis lead to abuses and dissolution 
of social values. The philosophy of 
guidance, however, does not call for any 
surrender to the laziness or irresponsible 
whims of pupils. Its purpose is not to 
decrease the control of the child by the 
school, but rather to make that control 
more intelligent and more effective. 
When teachers waste less time on teach- 
ing and ‘‘class-keeping”’ rituals which are 
admittedly futile for large fractions of 
our school population, when they give 
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more time to studying children as in- 
dividuals, in the light of comprehensive, 
cumulative records that are systematically 
kept up to date, there is every reason to 
believe that school control will be both 
more effective and more constructive 
When children begin to realize that their 
teachers are not merely policemen whose 
paramount duty is to “put over’ pre 
scribed courses which are irrelevant, or to 
enforce standards which are impossible 
but are devoted to helping them become 
better and happier people by meeting 
their needs whatever their needs happen 
to be, there will be fewer temptations for 
children to develop protective coloring in 
the form of the many anti-social and neg- 
ative attitudes and habits which now too 
frequently constitute the chief contribu 
tion of the school to its pupils. Unless 
the guidance and measurement move- 
ments help to bring about this change in 
the attitudes of both teachers and pupils, 
both movements will have failed in their 
first opportunity and basic obligation to 
society. 
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BEN D. woop (“The Major Strategy of 
Guidance’’) is Professor and Director of the 
Bureau of Collegiate Educational Research in 
Columbia College. He is the technical ad- 
viser to the Carnegie Foundation’s Study of 
the Relations of Secondary and Higher Edu- 
cation in Pennsylvania, and is also Director 
of the Cooperative Test Service of the 
American Council on Education, and of the 
Educational Records Bureau. Dr. Wood is 
author of Measurement in Higher Education 
and of Volume I of the Modern Foreign 
Language Study Reports. He is in demand 
as a speaker at educational meetings, and for 
each of several years past has made two or 


three extended lecture tours of the whole 
country. He is active in various research 
organizations, such as the Personnel Re- 
search Federation, the National Vocationa! 
Guidance Association, the American Educa- 
tional Research Association, and the Pro 
gressive Education Association. He is a 
member of the Technical Committee of 
NOC. 


F. S. BEERS, co-author with Dr. Wood of 
the above article, teaches in the Department 
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HAT is the practical value of the 
WV cic types of tests developed 

in such profusion during the past 
decade? In general, what sort of tests 
are there and how much reliance can be 
placed upon them in the guidance of an 
individual’s education or career? 

So many different views exist on these 
questions, and so little demonstrable evi- 
dence fortifies the answers thereto, that 
criticism or interpretation of the test situ- 
ation today is largely influenced by per- 
sonal opinion or experience. The middle 
ground—of conviction that sound tests 
do exist and furnish valuable evidence, 
not otherwise obtainable, for guidance, 
but that they must be used with discrim- 
ination and a meticulous scientific probity 
—is probably the most reasonable to hold. 

Nor is this statement a mere platitude. 
Its pertinence is attested on the one hand 
by the extreme distrust with which “‘psy- 
chological examinations” are regarded in 
some educational quarters; and, on the 
other, by the loose way in which tests 
have been widely adopted at various bu- 
reaus ofr institutions, without any real 
assurance of their suitability to the par- 
ticular situation in which they are so con- 
fidently employed. Pessimists retard the 
development of tests by refusing even to 
experiment with them; uncritical opti- 
mists endanger their future standing and 
improvement by using them without suf- 
ficient caution. 

II 

The various types of psychological tests 

most largely used may be roughly classi- 
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fied in several ways according to their 
form, their content, or their purpose. 
Those of character, personality, attitude, 
or interests form one important group 
which is concerned with personal adjust 
ment and reaction, rather than with ca- 
pacity or learning. 
Interest Blank, for example, performs a 
useful purpose by suggesting the profes- 
sion in which an individual may find 
himself most congenially located, and 
most stimulated by the nature of its ac- 
tivities. Yet it makes no pretense of 
measuring whether that individual has 
either the already achieved ability neces 
sary to succeed therein, or the apiitude, 
or power to acquire that ability through 
proper study and training. ‘‘Personality’’ 
tests do not attempt to measure learning 
or skill—they are concerned instead with 
types of behavior, such as extroversion or 
introversion, ascendance or submission, 


Strong's Vocational 


reactions to other individuals or to social 
situations, and other largely non-academic 
adjustments. 

This extensive group of personality or 
attitude tests, therefore, may be distin- 
guished from other “psychological” ex- 
aminations by reason of their different 
approach to analysis of the individual. 
Such devices, to be sure, have their scales 
and their norms, but they are not so much 
concerned as are aptitude and intelligence 
tests, with measuring the amount of in- 
dividual achievement in some given di- 
rection. Their scales do not all run in a 
continuous series from worst to best, or 
from zero to perfection. One person for 
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example may score high on the aesthetic 
and low on the political scale of an “atti- 
tudes” test, or high in scientific and low 
in legal “interest” on the Strong Voca- 
tional Interest Blank; but there is no in- 
herent quality of rightness or wrongness 
in such scores. They represent a sam- 
pling of individual tastes, opinions, or 
reactions. Clearly, personal variance in 
such matters is something of quite an- 
other order than are individual differ- 
ences in adding a column of figures, in 
reading ability, or in the operation of an 
automobile. The personality measure is 
essentially qualitative in nature, where 
the other sort of test is quantitative. 

Turning towards the latter type of ex- 
aminations (which measure the degree to 
which individuals differ not in attitudes, 
but in possession of abilities definitely 
recognized as desirable) we find that 
these are tests primarily either of achieve- 
ment or of aptitude. Both forms attempt 
to rank the individual, in relation to 
others, on some progressive scale of ex- 
cellence. Practically all the tests of gen- 
eral intelligence, specific performance, 
trade abilities, skills, aptitudes, and 
achievement are directly or implicitly 
graded in terms of a “norm,” or distri- 
bution of scores, among groups of people 
upon whom the measures have been 
“standardized.” 

An employment or trade test for pros- 
pective lathe operators is standardized 
upon actual lathe operators; one for pros- 
pective motormen upon motormen al- 
ready in service. Past records of these 
employes determine the criteria for satis- 
factory, superior, or inferior performance. 
Similarly “intelligence norms” for high 
school or college students are determined 
by giving an intelligence test to many 
such individuals, and comparing the test 
ratings with their academic records. Ap- 


titude tests likewise are tried out on pros- 
pective students or workers, and the 
relationship between their various scores 
made before special training or study, 
and their subsequent performance in the 
special field, are then analyzed. In this 
way a basis is developed for administer- 
ing the same tests to other individuals 
and therefrom predicting in turn what 
their probable future performance in such 
work or educability for it may be. 

Whether these measures which we 
have called essentially quantitative in na- 
ture fall into the achievement or the 
aptitude category depends largely upon 
their purpose—that is, whether their par- 
ticular aim is to measure past (acquired) 
or future (to-be-developed) accomplish- 
ments. In both cases, some type of past 
experience is necessarily sampled. One 
cannot test pure future educability except 
in terms of something which the indi 
vidual has already attempted. Aptitude 
for literary (verbal) studies can scarcely 
be measured in a child who is too young 
to read, or mechanical ingenuity in a sub- 
ject wholly unfamiliar with a level or 
pulley. So tests of aptitude proceed 
either by the method of analogy, or by 
that of testing a form of learning neces- 
sarily antecedent to that required for the 
future accomplishment in question. But 
they differ nevertheless, according to 
whether they look primarily forward (to- 
ward what the individual is likely to 
learn) or backward (at his level of ac- 
quirement to date). 

Thus study of the law involves (among 
other things) judgment in applying gen- 
eral rules to particular situations, analysis 
of complicated problems into their com- 
ponent “points” and the weighing of cer- 
tain resulting arguments against others. 
It is possible to test the ability to per- 
form these logical and analytical func- 
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WHAT ABOUT ALL THESE TESTS? 


tions without calling upon any actual 
knowledge of the law—but not without 
drawing upon sufficient previous training 
to ascertain whether prospective students 
possess these abilities in the abstract. A 
successful aptitude test reliably measures 
qualities essential in successful future per- 
formance, by sampling previously ac- 
quired skills associated or antecedent to 
those qualities, but without introducing 
elements which can only be acquired 
from the proposed future study. Such 
examinations attempt to forecast subse- 
quent progress by evaluating its known 
precursors. The child is still father of 
the man. Achievement tests naturally 
hold significance for future developments 
because a student’s accomplishments to 
date, whatever they may be, afford the | 
most reasonable basis for estimating his 
subsequent progress along related paths. 
But aptitude tests must definitely go fur- 
ther, and attempt to predict what the in- 
dividual may accomplish in the future if 
exposed to certain training which he has 
not yet had. Both types may differ 
widely among themselves in content, im- 
mediate objective, form, or level of diffi- 
culty. Thus an examination administered 
after appropriate training to stenograph- 
ers or to taxi drivers is very different 
from an achievement test in modern lan- 
guages or a College Board English paper, 
yet these all attempt to evaluate definite 
accomplishments. With aptitude tests 
again, we may find examples in both the 
vocational and the educational fields, 
quite unlike each other in subject matter, 
but with the same characteristic of seek- 
ing to measure educability, or specific 
learning capacity, rather than past ac- 
quirement, per se. Indeed both deal with 
the capacity to learn and whether we des- 
ignate them as vocational or educational 
merely depends upon whether the pros- 
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pective learning is usually obtained 
through occupational training or formal 
schooling. 

Ill 


Related to both phases of learning ca- 
pacity but particularly so to academic ap- 
titude, are the tests of “general intelli- 
gence” which, beginning with Binet's 
pioneer work, have contributed so vitally 
towards educational progress. Some of 
the most widely used, carefully prepared, 
and best standardized psychological ex- 
aminations are of this type. 
fulness for individual counseling, how- 
ever, is now more and more being called 
into question. Although we may accept 
the existence of “general intelligence’ 
(also variously referred to as IQ, aca- 
demic aptitude, mental alertness, Spear- 
man’s “g,” etc.) its nature and definition 
have never yet been agreed upon. More- 
over, different individuals may produce 
essentially the same total score on such a 
test by quite different means. One per- 
son may range between the 40th and the 
60th percentile on each section of the 
whole examination and be scored as aver- 
age. Another may reach the same gen- 
eral level by scores of around the 15th 
percentile in an arithmetical subtest, and 
around the 90th in verbal items (such as 
synonyms, vocabulary and the like). Still 
another may just reverse the latter proc- 
ess. Variations of this nature and extent 
are not found, to be sure, with most peo- 
ple, but it is precisely when dealing with 
the unusual that one should be able to 
recognize it and to heed what Truman 
Kelley has called the “individual idio- 
syncrasy.”” 

To illustrate further, an average school 
grade of 75 in English, history, mathe- 
matics and science means, for guidance 
purposes, one thing if it is composed of 
individual marks in these subjects, all 


Their use- 











70 to 80: and quite a 
if the individual obtains 


ranging from 
different thing 


marks of 55 in both English and 
history and of 95 in both science and 
mathematics. Each type of student 


makes a general average of 75, but 
educationally they are vastly different and 
require different handling and advice. 
The omnibus or “general intelligence’’ 
type of test, by the process of averaging 
scores on unlike mental problems, tends 
to obscure rather than to reveal those very 
differences which are most significant for 
individual guidance. In an exceedingly 
clear and able discussion of test construc- 
tion and objectives, Lindquist and An- 
derson state: “A single score as a com- 
posite measure of a collection of specific 
achievements is meaningful only to the 
degree that these specific achievements are 
homogeneous and interrelated, and loses 
meaning in proportion to their heter- 
ogeneity. Highly diversified character- 
istics must be measured separately. For 
example, one would not attempt to ex- 
press in terms of a single numerical meas- 
ure a composite of the weight, color, and 
utility of a piece of furniture.”* Brigham 
likewise, in A Study of Error says, “No 
one has ever demonstrated that it is le- 
gitimate to add such apparently hetero- 
geneous performances as detecting absur- 
dities, arranging a set of five weights 
differing by three, and copying a design 
from memory after a ten-second exposure 
—yet all standardized scales were based 
on the assumption that this very question- 
able procedure was legitimate. . . . The 
standardized scale draws attention to the 
total score on the scale. This total score, 
differently reached by different individ- 
uals, after transmutation into a mental 


1 Lindquist, E. F., and Anderson, H. R. 
“Achievement Tests in the Social Studies.” Edu- 
cational Record, Vol. XIV, No. 2, April, 1933, 


p. 239. 
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age scale and division by chronological 
age becomes an end in itself... . We 
accumulate tables of total scores on un- 
told numbers of children but advance not 
one step in the understanding of the es- 
sential nature of the separate problems 
Standardization obscures further insight 

Such realizations have lately chang 
the trend of intelligence testing from a: 
attempt to measure mental alertness or 
ability in general, to emphasis upon morc 
purely diagnostic tests of specific educa 
tional aptitudes. Brigham’s work in d 
veloping the Scholastic Aptitude Test | 
the College Entrance Examination Board 
has been outstanding in this recent move 
ment. He has clearly segregated the 
measurement of verbal and of mathemati 
cal abilities and has attempted as well to 
test the mental process—so important for 
engineering, architecture, and certain 
other studies or occupations—which is 
largely dependent upon an ability to deal 
with three-dimensional space relation 
ships in a constructive and intelligent 
way. 

Other tests aiming as these do, to 
measure students’ potential ability in spe- 
cific fields are being developed. In addi- 
tion to those mentioned above, aptitudes 
for pure science (as distinguished from 
that for engineering) and for languages 
give promise of being measurable. The 
most hopeful future usefulness of tests 
for the purpose of educational guidance 
seems to be in the development of thes 
tests of relatively specific and distinguish 
able aptitudes for one or another field of 
study. 

It should be borne in mind that such 
aptitudes can be determined, if at all 
only in respect to the particular situation 
toward which the individual is headed 


2 Brigham, Carl C. A Study of Error. College 
Entrance Examination Board, 1932, pp. 23-24 
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The level of attainment forecast for him 
must be expressed im terms of the group 
with which he expects to compete. The 
true significance of any such test— 
whether of aptitude for certain studies or 
for general academic promise—depends 
very largely upon how well it has been 
validated for the specific conditions to- 
wards which the prediction in question is 
directed. This means, in turn, that a test 
is of questionable prognosticating value 
for success in a given school or college or 
trade, until it has been satisfactorily 
standardized on the particular population 
(or some other of known comparability 
with it) whose ability, as a group, will set 
the standards of that success. 

This must be emphasized particularly 
with reference to educational tests, of 
whatever nature. After all, the stand- 
ards of satisfactory performance for a 
punch-press operator, or a short-order 
cook, or an accountant, or an actuary, or 
a railway engineer are pretty well estab- 
lished by employers, professional associa- 
tions, or unions. Such standards, more- 
over, have far more national significance 
and validity than do academic records. 
Amazing differences exist in the educa- 
tional achievement and future promise of 
pupils from different schools in the same 
state, or even from the same city. State 
and city norms likewise differ widely 
from each other. Even for accredited in- 
stitutions giving comparable degrees, the 
Pennsylvania Study,* for example, has re- 
vealed the best students in certain “‘col- 
leges” show a level of achievement below 
that of the worst students in some others. 


IV 
Probably the most common fallacy, or 


*“The 1932 College Sophomore Testing Pro- 
gram.” Report by the Advisory Committee on 
College Testing. The Educational Record, Vol. 
XIII, No. 4, October 1932, pp. 290 ff. 
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oversight, in testing today is careless neg 
lect of this simple fact—that every test 
should be tried out and standardized in 
respect to the group on which it is going 
to be used. There is altogether too much 
loose assumption, because a certain “‘reli- 
ability and validity” have once been re- 
ported for a test, that this fixes a constant 
measure of these values. Validity is not 
inherent in any examination, irrespective 
of the group tested. If it were, we could 
use the Otis or the Stanford Achievement 
or the Thorndike Test or a College Board 
examination equal effectiveness 
among literate English-speaking South 
Africans, Hawaiians, Australians, En- 
glishmen, and Americans. (In fact if a 
test had absolute validity even the “lit 
erate English-speaking’ condition might 
be removed and the examination extend 
to Hottentots, Malays, and Bushmen as 
well.) The necessity for using tests ap- 
propriate to the general culture of those 
tested, and fully comprehensible by them, 
is thus obvious; yet almost equally impor- 
tant considerations as to the background, 
educational level, experience and degree 
of selection in general—characteristic of 
the school and population to be exam- 
ined—have often been completely ig- 
nored in the administration of psycholog- 
ical tests and the interpretation of their 
results. 

This stricture must be emphasized 
especially in respect to examinations 
which are good in themselves, adequately 
standardized and reliable for a partic- 
ular purpose, but which are later un- 
critically employed with groups quite 
dissimilar from those for whom they 
were originally devised. Pupils in dif- 
ferent grades, apart from their scholastic 
achievement or intelligence, may react 
to the same questions in quite dif- 
ferent ways simply because of their 


with 











greater or less maturity. Tests designed 
for a certain grade may yield curiously 
contradictory results from a more ad- 
vanced or sophisticated population whose 
greater insight opens up unexpected 
meanings or connotations. Extensive 
analysis of individual (true-false) items 
in a series of final Law School examina- 
tions reveals that about one question out 
of six is answered “correctly” by more 
poor students than it is by superior ones. 
The latter read into the problem compli- 
cations not intended by the instructor or 
visualized by their less able classmates. 
An early form of the Legal Aptitude 
Test was tried out on the faculty, honor 
students, and entering class of the Yale 
Law School, as well as upon undergradu- 
ate freshmen. The less mature and un- 
sophisticated entrants did better than the 
faculty on certain items designed to test 
“logical inference’ or “legal principles” 
—obviously not because they knew more 
law but because they knew none. The 
questions had been designed to test a 
naive, not a learned, mind. In other 
words the reliability and validity of spe- 
cific test items may vary considerably for 
different educational levels. Even the 
best of tests should not be expected to op- 
erate effectively unless the conditions and 
the people tested are those for whom it 
is appropriate. 

Furthermore, certain tests now con- 





OCCUPATIONS 


stantly advertised and extensively used 
appear never to have been satisfactorily 
standardized on any adequate group 
They, too, may be good tests, but there is 
precious little evidence to prove it. As 
the author has already published illustra- 
tions of this point* he will not elaborat. 
it further here. Suffice it to say that but 
little scientific substantiation has thus far 
been offered of the claims advanced for 
numerous tests on the market today. 

Individual guidance is a sort of mental 
physic, and as in the case of any other 
medicine, its contents and action should 
be known to the doctor and its power 
suited to the patient. The right sort 
of psychological examinations, properly 
used, may often prove extraordinarily ef- 
fective instruments for educational and 
vocational guidance. Their employment 
carelessly, indiscriminately or (even with 
the best of intentions) too naively may do 
positive harm to some of those counseled 
More scientific scrutiny and control of 
these instruments which, like drugs, have 
their dangerous as well as helpful pos- 
sibilities, is badly needed. By no means 
should we forego their use—but we 
ought to have a psychological pharma- 
copoeia, to say nothing of a Pure Norms 
and Tests Act. 


4 Crawford, Albert B. “Some Criticisms of Cur 
rent Practice in Educational Measurements.” Har 
vard Teachers Record, Vol. 3, No. 2, April 1933 
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TESTS AND TECHNIQUES | 

In a State-Wide Minimal Guidance Program | 

HERBERT A. Toops ; 

nr — SSS 3s 


practically, a state-wide guidance 

program for high school pupils, one 
differs somewhat in one’s viewpoints 
from a high school principal who attempts 
to formulate a local guidance program. 
In the first case, ideals are set, and the 
difficulties of execution in concrete situa- 
tions are minimized. 

The local high school principal, on the 
other hand, is beset with such problems 
as the scheduling of the hours, rooms, 
and teachers for each of four successive 
intelligence tests, the choice of a teacher 
with interest in and aptitude for coun- 
seling, and the redistribution of the teach- 
ing load so that the teacher may have time 
available for interviewing and guidance 
functions. Yet, having mastered these 
difficulties, the local principal may con- 
fidently look forward to the attainment 
of positive results. For example, he may 
assume more or less correctly that most 
of his pupils and most of his graduates, 
providing he has an adequate guidance 
program, will find a more or less satis- 
factory placement in industry, business, 
and the professions. At least, all guid- 
ance theorists in their texts and treatises 
make such assumptions. But one who 


I FORMING, either theoretically or 


This ps paper draws heavily from previous pub- 
lications of the author as follows: Toops, H. A. 
“A Minimal Guidance Program for Secondary 
Schools,” Ohio High School Bulletin No. 9, 24 
pp. mimeographed; Toops, Herbert A. “The Pos- 
sibility of General Selection,” Proceedings of the 
Association of Obio College Registrars and Exam- 
iners, 1933. 19 pp. mimeographed. 
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plans a minimal state-wide guidance pro- 
gram must, of necessity, test and ques- 
tion all such assumptions. 

In the local situation adequate place- 
ment may well be a fact, provided: (1) 
that there is an ever-increasing demand 
for, primarily, the “white-collar” occu 
pations; (2) that all or most of his fel- 
low principals, in the larger community 
of which he is a part, give very little or 
very inefficient guidance, so that by the 
default of the latter his pupils have a 
competitive advantage in placement; (3) 
that it can be assumed that a larger and 
larger proportion of the graduates upon 
graduation will leave the community in 
order to obtain the occupational place- 
ments necessary to bring “opportunity 
within the grasp of ability, aptitude and 
interest.” In the past all three conditions 
have obtained to such an extent that any 
school principal inaugurating a good 
guidance program confidently could hope 
to dispose of the product of his school. 
The picture for the future at first glance 
is not so rosy in any one of the three 
aspects. 

In the first place, although for forty 
years the population has been growing 
very tapidly each year up until about 
1927, yielding an increase in population 
larger than the increase of the previous 
year, the increases of each year since 1927 
are smaller and smaller with each succes- 
sive year. Accordingly there is already 
noticeable a considerable slowing-up of 
the national population. Statisticians of 








‘ 
' 
ia 
‘nf 





OCCUPATIONS 


population give different estimates of the 
ultimate population of the country and 
of the time of its attainment, it is true, 
but roughly there is remarkable agree- 
ment in their predictions: — 

(1) That we shall add only 20 mil- 
lions to 60 millions more to our popu- 
lation; (2) that most of our future na- 
tional population growth will have been 
completed in the next 30 to 50 years at 
most. 

The possible implications of the slow- 
ing-up and ultimate stoppage of growth 
of the population are momentous. As an 
example, in future the farmer who in- 
vests in a farm cannot hope that an ever- 
and-ever increasing number of mouths to 
feed and backs to clothe will continue 
to mean an ever-and-ever increasing de- 
mand for his corn, wheat, hogs, and 
wool. Again, the industrialist who con- 
structs a factory cannot hope for a con- 
stantly increasing demand for his prod- 
ucts and rising profits from them, unless 
they be unique, answering a new demand 
created by new wants of consumers, and 
also relatively freed from competition by 
such expedients as patent-protection. 

A second very important implication 
lies in the statistics on growth of popu- 
lation. Since 1890, when practically no 
one went to school, the whole high school 
movement has come about. At the present 
moment practically every grade school 
graduate in Ohio (which has an 18- 
year minimum age leaving limit—earlier 
in case of proven need) at least starts 
to high school. With every two grades 
of schooling obtained, the pupils cor- 
respondingly affected hope to rise over 
the status of their parents by at least one 
step in the socio-economic scale indicated 
by the qualitative labels of: labor, un- 
skilled factory work, trades, business, 
executive and managerial work, profes- 
sions. This is a precious American tra- 


dition—the tradition, concretely, that “In 
America anybody can become president.” 
Such a trend of socio-economic rise of 
son over father might presumably con 
tinue indefinitely if the population of the 
country should continue to increase as it 
did between 1910 and 1927. 

Corresponding to the high school de- 
velopment, a somewhat delayed but equa! 
ly impressive movement recently has oc- 
curred in the number of people going t 
college, and consequently in the numbers 
of college graduates and people intend- 
ing to enter the professions. As recently 
as three decades ago people knew little 
or nothing of the engineer, the chemist 
the physicist, the professional inventor 
the research worker, and all that host of 
professional people that have made 1933 
a more livable year—depressions excepted 
—than any year in all history. 

Each year it is increasingly apparent 
that we are approaching the saturation 
point in the top-most occupations, even 
as in production of automobiles. The 
amount of work to be done in the old 
way is decreasing all along the line. Most 
of our forests have been cleared. A 
great many of our bridges and roads 
have been built. We have as many 
schoolhouses as we need, and in fact are 
demolishing schoolhouses faster than we 
are building them. We do not have 
nearly as many hospitals as we need, but 
we do have almost as many as we are 
able to afford at the excessive fees charged 
for the services rendered. We have an 
excess of farmers, although not an excess 
of farm products in the hands of all po- 
tential consumers. There are entirely too 
many stores, and four times as many fill- 
ing stations as the country needs. In fact 
we have almost enough or far too many 
of everything produced by the big exist- 
ing occupations. Is it not obvious that 
the graduate of tomorrow, either of high 
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school or of college, must seek to render 
an unique service to humanity, one now 
not rendered at all or at least fulfilled 
imperfectly? 

If this conclusion be accepted, then the 
great problem in guidance for the future, 
as the writer sees it, is that of exploiting 
the unusual capacities, specialized abili- 
ties, fare experiences, and specialized 
training of all pupils. On the side of 
school organization, the problem would 
involve the devising of an educational 
system which would turn out individuals 
better equipped with initiative and 
adaptability than ever before. A uni- 
form standardized curriculum simply does 
not fit the need. The ancient and hon- 
orable curriculum of Latin, algebra, 
geometry, English, ancient history, and 
geogtaphy will be due for a pretty care- 
ful overhauling in the next 40 years. So 
also will the curricula of the colleges be 
compelled to respond to the changed 
condition of affairs. 

Now let us return for a moment to 
the second condition above, namely, 
that any school might readily place its 
graduates and its eliminees provided its 
fellow schools were lacking in the guid- 
ance function. If we admit the possi- 
bility of a thorough overhauling of edu- 
cation generally, then is it not immedi- 
ately obvious that guidance will become 
one of the most important functions of 
every school system? Will not every 
school be compelled as a self-protective 
measure—if no worthier motive be found 
—to adopt at least a minimal guidance 
program? It seems reasonable to suppose 
that the school of the future will be more 
concerned with attempting to induce in 
the pupil a great eagerness for learning 
than with efforts to cram home a set num- 
ber of pages in any set curriculum or 
even in any highly individualized curricu- 
lum. Increased emphasis may also be 
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predicted in the matter of providing for 
the student those minimal tools which 
make _ possible 
throughout life, namely: reading, efficient 
computation, rules of thinking, and 
techniques of writing, drawing and 
speech-making in order to influence 
people. It seems not illogical to expect 
in 20 or 30 or 40 years that the schools 
may abolish diplomas entirely and that 
every graduate of every grade automati 
cally may be considered to be a candidate 
enrolled in the next grade. Instead of 


continued _ learning 


expressing success or failure by a single 
percentage mark, for example, each pu- 
pil might receive many detailed marks in 
each subject pursued—for example, a 
mark in knowledge attained, another in 
thinking power, another in ability to 
make inferences and apply principles, 
another in vocabulary attained, another 
in the social and ethical implications of 
the principles of the subject matter. In 
brief, education may become strictly pro- 
fessional. Guidance may be a part of the 
training and practice of every school ad- 
ministrator. And, from the viewpoint of 
our problem, no school could hope to 
function satisfactorily by reason of the 
default of any or every other school in 
the guidance function. 

When we consider the third possi- 
bility—that the school might satisfac- 
torily place all its pupils in case a great 
many emigrate to other communities to 
effect a satisfactory placement—it is ob- 
vious that already there is a consider- 
able reversal of the trend from country 
to city which was characteristic of the past 
thirty years. Likewise such a readjust- 
ment can take place maximally only in a 
rapidly expanding population. From 
this line of reasoning it would seem that 
communities will be compelled to be in- 
creasingly self-sufficient, will have to 











make occupational provisions for a larger 
and larger portion of their inhabitants. 


I] 


Summing up the entire matter then, 
as never before the times call for an 
education which will enable the indi- 
vidual to be adaptable in a future which 
he is incapable as never before of antici- 
pating. Such an education will be a true 
consumer's education, and probably will 
come about only after there has been a 
widespread attempt by competent re- 
search workers to determine ‘‘the forty 
things most worth knowing.” This cur- 
riculum revision movement will in gen- 
eral retain those subjects which will add 
to the individual’s “general adaptability.” 

Social philosophers are convinced that 
the next 40 years will show a great in- 
crease in education for leisure; that pro- 
fessional treatment of every human need 
will become a commonplace; and that in- 
creasingly the pursued occupations of 
mankind will group themselves at or near 
the top of the socio-economic series men- 
tioned above. Granting these premises, 
the academic struggle of cultural vs. prac- 
tical education must be dropped. Edu- 
cators will be obliged to concentrate upon 
devising a carefully-planned curriculum 
which will hold the best features of both 
cultural and practical education, and 
which will aim, in the elementary and 
secondary schools, at training for adapt- 
ability. On the face of things, Latin, 
Greek, algebra, and geometry will not be 
grist for the educational hopper. 

In all the turmoil which the author 
predicts as imminent each local school 
administrator rightfully will strive to se- 
cure the best possible education and the 
best possible placement for his graduates 
and eliminees. These administrators will 
serve, as well as may be hoped for, to 
exploit the individual aptitudes of all 
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idiosyncratic (‘‘differing’’) individuals 
The program obviously needs support, 
however, from centralized sources such as 
the State Department of Education and 
the State College Association. 

Briefly the future program should con- 
sider the following basic factors: 

1. The enormous need for the high 
school to provide occupational and life 
training for those who now drop out 
without graduating. A college-prepara- 
tory education does not meet their needs. 

2. The enormous wastage of intel- 
lectual talent which fails to continue in 
school to the point of maximal individual 
profit. 

3. The need for scholarships for 
students with the ability to succeed in 
college, who are possessed of vision but 
are not possessed of financial means. 

4. The wasted effort spent in college 
on those who come for other than edu- 
cational purposes. 

5. The impending over-supply of 
workers in the clerical, managerial, and 
professional occupations—wnless we te- 
vise our concepts of the amount of such 
services needed in the world and the 
means of payment. 

6. Neither high school nor college is 
fulfilling its best functions. The high 
school holds to an outworn ideal of cul- 
ture and college-preparation at the ex- 
pense of adequate provisions for those of 
lesser intelligence. The college neglects 
its important function of training the 
leaders of tomorrow. Both, obviously, 
need to overhaul aims, curricula, teach- 
ing methods, and teaching equipment. 

The educational needs of all adults 
are not being met simply by enrolling in 
the colleges some 10 per cent of high 
school graduates and eliminating one- 
third to two-thirds of them before gradu- 
ation. Clearly then, we need: to provide 
useful educations for those who cannot 
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keep the pace in a college preparatory 
program in high school; to plan for 
the few individuals in high school who 
desire to join an occupation for which 
college training is no great advantage if 
not a detriment; to attempt to prepare the 
attitudes of pupils for the industrial, 
economic, and social changes which are 
imminent; to release the high schools 
from their bondage to college entrance 
requirements; to give every pupil a 
chance, if possible, not only to attend 
but also to profit by high school; 
to eliminate the feeling—too often a true 
feeling—that education has nothing more 
to contribute to the individual after he 
receives his diploma; to revise the cur- 
ricula of the colleges in the light of the 
impending changes in the nature of oc- 
cupations; to prepare leaders for the in- 
creasing problems which for the next two 
or three generations we undoubtedly shall 
face by reason of the transition from a 
rapidly-growing to a stable, grown-up 
society; and to prepare for a profitable 
use of the increasing leisure which a 
grown-up but progressive society abun- 
dantly affords. 

A number of conditions, primarily of 
a planning and a standardizing nature, 
must receive the care and attention of 
some official central body if all these aims 
are to be attained. The practicing phi- 
losophy of a local principal may differ 
and should differ, in the way above noted, 
from the philosophy of the whole state- 
wide movement which cannot postulate 
a “mobility of labor” to other states and 
foreign countries—as yet. (We may be 
thankful we do not have, or are not likely 
to have, the excess-population problem of 
Japan!) 

If the colleges and the secondary 
schools and the elementary schools are to 
cooperate to the best advantage, there 
must be a great deal of standardization 
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of record forms, of tests and test 
Technical guidance vocabularies m 
made uniform if even a minimal 


ance program is to function efficient 
and to the additional end that fellow 
workers in guidance shall be able to 


understand one another in regional 
state-wide conferences, when making or 
listening to speeches, and when read 
or discussing the more formal treatises 
on guidance. Serial numbers for all em 
ployed teachers, for all schools, political 
subdivisions, curricula, etc., should be 
arranged to allow centralized school sta- 


, 


tistics to be speedily amassed by punch 
card methods. These records should have 
a maximal amount of common definition 
of terms employed and a maximal amount 
of “usability of the results.” These mat 
ters are of no small moment for the 
eventual success of the future education 
as envisioned, and so must be provided 
for by a headquarters organization 


Ill 


Such requirements, as they have devel 
oped year by year, have led to the crea- 
tion of a continuing research body in the 
Ohio College Association—the Commit- 
tee on Intelligence Tests for Entrance 
This Committee has demonstrated by 
state-wide intelligence testing program 11 
Ohio that the colleges of Ohio, several 
years ago, were drawing almost a ‘run of 
the mine” sampling of the graduating 
seniors. Ohio has some 48,000 high 
school graduates each year. The intelli- 
gence tests show that some 24,000 high 
school seniors are above college 40-per- 
centile intelligence, measured by norms 
based on freshmen students tested in the 
50 or more Ohio colleges. But the 50 
Ohio colleges enroll only 12,000 students 
and of every centile rank, 1 to 100, which 
means that these colleges could recruit 
their present numbers twice over from the 
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very capable talent of which the state has 
an abundance. To do so would make 
college failure unnecessary, save as a pos- 
sible disciplinary measure. To draw the 
student body from such talent would raise 
the level of college instruction and in- 
crease the probability of producing the 
leaders who will be needed in the future. 

It is reasonable to believe that, if the 
curricula were what they might be, the 
colleges might appeal to far more than 
12,000 new individuals annually. On the 
other hand, the cost of college attendance 
has been mounting over a long period 
Some twenty years ago the colleges of the 
state estimated at $300 to $350 the aver- 
age annual expenses of college attend- 
ance. Comparable figures published re- 
cently quote $600 to $800 as the average 
outlay. In those same twenty years the 
“real wages’ of farmers, machinists, 
ministers, clerical workers, teachers—who 
in the main are the parents of the col- 


lege students—have not increased to a 


like deegree. Accordingly we may con- 
clude that college is becoming too expen- 
sive. That coincidentally college profes- 
sors’ salaries may be too low and college 
education too expensive is a paradox for 
the able college president to solve! 
Again the high schools have elimi- 
nated enormous numbers of their en- 
trants without diplomas. Many of these 
are intelligent; and many of those who 
are not very high in academic intelligence 
nevertheless possess good to excellent 
special aptitudes. Any state director of 
guidance, looking over the field of his 
administration, would note these reser- 
voirs of intellectual and _ specialized 
talents which are not being developed by 
our current educational system. He would 
see the graduates and the eliminees with 
high intelligence or high special aptitude 
or both, who have ‘“‘ceased to grow” 
educationally and intellectually, or even 


occupationally. Perhaps then the logical 
conclusion is that the college should go 
to the student, if now it is too expensive 
for the student to go to the college; also 
that perhaps the high school should go 
to the pupil who has dropped out with- 
out graduating. 
IV 


Just such considerations as these have 
actuated the Ohio College Association in 
proposing a minimal guidance program 
for the Ohio high schools. This program 
has five objectives: 

1. Raising the standard of intellectual 
competence of teachers in Ohio. [By state 
statute, all candidates for teaching in 
Ohio must pass a test of general ability. 
The minimal standard in the past decade 
has risen from a 7-percentile intelligence 
standard to a present 26-percentile lower 
limit. } 

2. The actual inauguration of at least 
a minimal guidance program in the Ohio 
secondary schools. 

3. Raising the professional and tech- 
nical excellence of guidance work. 

4. The progressive freeing of the 
secondary schools from the bondage of 
college-entrance requirements, as rapidly 
as they give evidence through adoption of 
guidance measures and revised curricula 
of willingness to accept the corresponding 
responsibilities. 

5. The promotion in the Ohio col- 
leges of a competent personnel program 
looking toward the ultimate revision of 
college curricula and personnel practices. 

Only the second of the above measures 
can be discussed in the space available. 
Accordingly, we present only a selection 
of the minimal proposals recently dis- 
tributed to 1,800 Ohio high schools: 

1. Annual intelligence tests of every 
Ohio high school pupil, so that by the 
time the pupil is ready for college a very 
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reliable measure of his intellectual prom- 
ise will be available. 

Justification: No instrument thus far 
devised is so effective as the intelligence 
test to bring about understanding of the 
individuality of the child, his capacities, 
and limitations, and to spread abroad in 
the land a conviction of the very urgent 
need for individual adaptation of cur- 
ricula. 

A single intelligence test of an indi- 
vidual may be an unreliable measure of 
his promise. It is highly desirable there- 
fore to have an annual intelligence test 
and to let college guidance, for example, 
be based upon the results of from two 
to four such annual tests. In Ohio, by 
an ingenious adaptation of test methods, 
we have reduced the per capita price of 
a two-hour work-limit intelligence test to 
about 214 cents, making the total bill for 
a pupil’s four testings throughout high 
school amount to approximately 10 cents. 

One of the important outcomes of this 
testing program will be, we hope, the 
realization on the part of the high school 
teacher of the tremendous number of very 
capable people for whom at the present 
time no adequate educational provision 
has been made. As a second objective we 
hope to convince the high school authori- 
ties that this waste of intelligence is no 
new phenomenon, that it has been going 
on for years, and that in this group there 
might be many individuals who would be 
much interested in extension education 
of a worthwhile type if it could be 
brought to them in an interesting way. 

2. Annual scholarship tests of every 
pupil, on tests carefully designed to mea- 
sure “the newer objectives of education.” 
These should be accompanied by syllabi 
of minimal essentials, formerly planned 
and distributed but recently abandoned as 
a result of legislative deficiencies. 
Justification: Such contests put scholar- 
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ship on a par with athletics as to desir- 
ability in the pupils’ eyes. Painstakingly 
devised, such tests can become the pace- 
setter of aims for the secondary schools 
of our state as well as prognosticators of 
college success. As soon as such tests can 
be made diagnostic they will be invaluable 
for remediation of tool subjects and for 
testing the merits of competing pedagogi- 
cal methods. When several such tests, 
each measuring a separate outcome of a 
given subject—technical vocabulary, 
knowledge, thinking power, ability to ap- 
ply principles to every-day situations— 
shall have come into universal use in our 
elementary and secondary schools and 
colleges, we shall have attained an even 
more important instrument than the in- 
telligence test for rendering visible and 
making concrete the need for revision of 
the curriculum. 

3. An annual transmutation to a com- 

mon basis by Hollerith machine of the 
marks of all graduating Ohio high school 
seniors. 
Justification: An average mark of 60 
or 70 in High School “A” often indicates 
the same degree of attainment as an aver- 
age mark of 90 in High School “B.” 
Statistical methods are available’ for ren- 
dering comparable the marks of different 
high schools. 

Marks measure certain character quali 
ties not otherwise measured. Obviously 
a high average mark over four years can 
be obtained only through brilliance or 
systematic high industry, or both. Like- 
wise a low average mark over four years 
means low intelligence or a systematic 
lack of application. It is reasonable to 
presuppose that the individual habit of 
success or failure is very important, and 
the dispersion (standard deviation) of the 


1 Toops, Herbert A. “The Transmutation of 
Marks,” O. C. A. Bulletin No. 88, pp. 1093-2000 
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marks should reveal something of their 
Significance in this respect. Concretely, 
two boys “H” and “K” average 2.00 
(average) in scholarship, but ‘‘H’” has 
received A, B, C, D and E marks in about 
equal proportions, while ‘‘K’’ has made 
“practically straight C’s.” Which of the 
two offers the better chance of ‘‘academic 
salvation?” 

4. The placing of a copy of a re- 
vision of “Opportunities in Ohio Col- 
leges’’*—a composite catalog of all of the 
50 or more Ohio Colleges—in the hands 
of every senior early in his senior year 
Justification: Every pupil should make 
inquiry into several colleges before choos- 
ing which college he will enter. 

5. The annual distribution to each 
parent of each child of a form blank on 
which the parent may request interviews 
with the pupil's teacher, the school guid- 
ance counselor, or representatives of Ohio 
colleges. 

6. The appointment in each school of 
at least one teacher (or principal) to serve 
as a guidance counselor for the school. 
The teaching burden of this teacher 
should be lightened sufficiently to enable 
him actually to function in this capacity. 

7. The holding annually of at least 
one guidance interview with every pupil, 
no matter whether he seems to need it or 
not. For those known to have problems, 
as well as those found to have unsus- 
pected problems, appropriate programs of 
action will be mapped out. 

8. The adoption, as soon as a Satis- 
factory one can be devised, of a uniform 
cumulative record blank for the Ohio 
high schools, with a time projection, to 
supply the colleges and subsequent 
schools with a much more complete ac- 


2 Edgerton, H. A., and Toops, H. A. Opportuni- 
ties im Obio Colleges. State Department of Edu- 
cation, Columbus, Ohio, Guidance Manual No. 3, 
1931, 203 pp. 


count of the pupil's abilities, attitudes, 
plans, and ambitions than hitherto has 


been possible. 
9. Each school to make some special 


provision for the one pupil in a school 


who wants to be an author, or a drama- 
tist, or an efficiency manager — the one 


future representative of an occupation 


from the school in question. 

10. An attempt to do something 
further the education of the graduate: 
the last year or two who are not able t 
go to college; particularly those who ar 


at the present time unemployed. The 


seriousness of the problem of hundreds of 


thousands of unemployed youth, unable 


or unwilling to attend school, warrants 
something drastic being done at the 
present moment. 

11. An annual physical examination 
of all pupils, with a subsequent attempt 
to treat all remediable defects. 

12. Induce all teachers to read Guid- 
ance Manual No. 14 

13. Average the high school marks of 
every senior for his entire high school 
career. Report his average and rank to 
each such pupil, and discuss its signifi- 
cance from the viewpoint of his probable 
success in college. 

14. Obtain for the school library a 
good supply of college catalogs. Keep 
several copies of ‘Opportunities in Ohio 
Colleges” on the same shelf. 

15. Give at least one assembly talk 
on “Going to College” or on “College 
and Career.” 

16. Give stressed group attention to 
the guidance of the following groups of 
pupils: 

a. Girls, generally. (In a depres- 
sion the problem of occupations for 
gitls becomes acute.) 


8 State Department of Education, Columbus, 
Ohio, Introduction to Guidance, 1931, 349 pp. 
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b. Boys and girls with parents who 
are not professional people. 

c. Girls who have decided to go into 
teaching (below college grade), sten- 
ography, and nursing — occupations 
which are overcrowded at the present 
time. 

d. Boys and girls who have not yet 
decided regarding college, particularly 
the brilliant and scholarly. 

e. Brilliant and scholarly boys and 
gitls who have decided against going 
to college for financial reasons. 


17. Each teacher should be asked to 
read one book on guidance annually. 

18. The Ohio colleges to adopt a unt- 
form college entrance blank, so that the 
school principal can make out the college 
application blank for every senior, regard- 
less of college intention, before leaving 
for his vacation and while every teacher 
is available to supply any needed informa- 
tion. This will have the effect in time 
of making every senior capable of college 
attendance think of college as a pos- 
sibility. 

19. The Ohio colleges, with the ap- 
proval of the standardizing agencies, to 
free the high schools from college en- 
trance considerations at least so far as the 
senior year is concerned. The senior year 
might then be used for needed remedia- 
tion, for a special occupational training 
of those definitely not going to college, 
and in some cases to speed up the time 
of entry to college by allowing pupils to 
take more than the normal load of work. 
Anything which will bring about the 
abolition of the present breaks between 
the several school systems is devoutly to 
be desired. Freedom from college en- 
trance considerations should also bring 
about a curriculum more appropriate to 
the needs of individual pupils, keeping al- 
ways in mind the fact that the next 40 


[27] 


the past 40 years. 

20. The preparation of a 
graphed book of the ratings on intelli 
gence, scholastic tests, transmuted mark 
and college intentions of all seniors 
all high schools annually, a copy of ¥ 
might be furnished to each college 


March 1. 


21. The annual formal notification 
the 20,000 or more hich school senior 
of “highest aptitude ” in regard to their 
probable unconditional admission ¢ 
of the Ohio college If colleges be 


unwilling to go so far, then to certair 
(specified) colleges. This formal notifi 
cation, obviously, would have no concern 
with the pupil’s expressed intention of 
going or of not going to colleg 
pose is simply to stimulate a larger num 
ber of the promising pupils to apply. The 
ideal is to make the applying an automatix 
procedure, just as at the present time any 
eighth grade graduate automatically is a 
candidate for high school 
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Vv 
To inaugurate such a program with 
the least difficulty there should be little 
or no discouragement from central head 
quarters of the 28,000 seniors of lesser 
promise, other than that implied 
failure to receive such a notice. The dis 
couragement, with respect to college, of 
those of lesser intellect should be done 
by the high school counselor in confer- 
ence with the pupil and (or) his parents 
and should be “‘the logical decision” of 
the pupil and his parents. This proce- 
dure may be followed with real advantage 
to each individual, provided the school 


pupil possesses and then endeavors t 
enlighten and interest him in the possi 
bilities of such aptitude-exploiting « 
Surely interests are no more sacred than 
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knowledges, attitudes, and skills. And 
consequently—as in the analogous cases 
—schools should seek to change interests 
when they are not in line with the pupil’s 
ability, but, in accordance with accepted 
guidance philosophy, should not seek to 
enforce compliance. 

Such a program as we have outlined 
above is both minimal and, perhaps for 
the time, ideal. We do feel, however, 
that in Ohio we have made a great deal 
of progress along the directions indicated. 
We are optimistic enough to hope that 
a decade of prosperity will not only see 
the more worthy portions of the above 
program adopted but also a great deal 
more which at the present moment we 


HERBERT A. TOOPS (‘Tests and Techniques 
in a State-wide Minimal Guidance Pro- 
gram’) is Professor of Psychology, Ohio 
State University. During the war, Dr. 
Toops standardized and later assembled 
trade tests in some 90 different trades. Fol- 
lowing the armistice he adapted trade tests 
for the U. S. Employment Service, and later 
specialized in the construction of vocational 
tests for the Army. In connection with his 
a appointment, he directs the intel- 
igence testing program at Ohio State Uni- 
versity, the cooperative researches of the 


cannot foresee. A _ highly-trained and 
highly-paid guidance counselor and 4 
formal guidance department or research 
bureau is not essential to good guidance 
The problem, as the Ohio College Asso- 
ciation Committee sees it, is simply to 
assist wherever possible by technical 
advice and encouragement of discussion 
in forwarding the movement in its initial 
stages. The next 40 years bid fair t 
stress “quality” rather than “quantity” in 
professional thinking, public discussion 
and education. There is no doubt in our 
minds, therefore, of the recognition of 
the importance of guidance as a school 
function in the educational program of 
the future. 
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Ohio colleges, and the state-wide high school 
intelligence testing program. He has served 
on a number of educational committees and 
as statistical consultant on important re- 
searches, notably the mechanical ability in- 
vestigation at the University of Minnesota 
At present he is striving to interest the high 
schools and colleges of Ohio in uniform per 
sonnel practices, a minimal guidance pro- 
gtam, conservation of human talent, and 
scholarships for the able but needy. He is 
author or co-author of many articles, research 
reports, monographs, and books. 


TROUBLE WAS, IT WIGGLED 


Adjustment Service, New York City, reports a recent client who, after 
spending several minutes in a futile effort to assemble the O'Connor 


Wiggly Block, said to the counselor: 


warped.” 


“I can’t put that thing together—it's 


er 
hN 
oo 

i 














*d and 
and 4 


esearch 
idance 
> Asso- 
ply to 
chnical 
“ussion 
initial 
fair to 
ity”’ in 
1ssion. 
in our 
on of 
schoo! 
am of 


school 
served 
S and 
it re- 
ty in- 
esota 
high 
1 per- 

pro- 

and 
He is 


earch 


28 } 





ee 




















| SCIENTIFIC PERSONNEL SELECTION 


In the United States Civil Service 


L. J. O'RourRKE 


——— 08 

















ANY vocational counselors as well 
M as commercial teachers have 
voiced the need for a more ob- 
jective basis of determining the actual 
qualifications which industry demands of 
employes, the relative proficiency of peo- 
ple who are considered satisfactory by in- 
dustrial firms, and the extent to which the 
requirements vary in different industries. 
Obviously it is important to know 
whether or not, from the standpoint of 
the requirements of practical work, we 
are giving too much or too little attention 
to each subject in our curricula. 

During the past year or two, the U. S. 
Civil Service Commission has been carry- 
ing on cooperative studies with various 
industrial firms. The objectives of the 
project are, in addition to improving se- 
lection methods, to determine standards 
in industry and Government; to deter- 
mine the degree of attainment in each 
commercial subject which must be reached 
if the student is to meet the requirements 
of industry; to- release these data to the 
counselors as a basis for adjusting their 
problems; to make available to schools 
the measures by which the attainment of 
students can be determined, in order that 
it can be ascertained, a year or more in 
advance of graduation, in which subject 
or subjects the students need additional 
instruction. 

Our preliminary study of the causes of 
dismissal of stenographers indicates that 
additional time might more profitably be 
devoted to improving command of Eng- 
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lish than to acquiring an exceptionally 
high speed in taking dictation. 

Before the stenographic program was 
undertaken in industry, great care was 
exercised to insure that the tests to be 
used should be the ones best suited to 
the selection of stenographers and typists 
Careful study was made of the selection 
methods and tests previously used by the 
Commission, and those used by private 
industry. 

Since it has been a generally expressed 
criticism in the past that stenographers 
and typists secured through former ex 
aminations were “unable to use their 
heads,” a general test consisting of judg- 
ment, vocabulary, reading, comprehen- 
sion, spelling, and English usage items 
was introduced into the examination. This 
test is a measure of the adaptability and 
the knowledge which a typist or a sten 
ographer should have. Comparative re- 
sults of these tests are shown in Table I 

In addition to the general test, the 
new examination consists of two tests of 
actual typewriting ability, and, for stenog 
raphers, two tests of stenographic ability. 

When the research work incident to 
the construction of the new tests had been 
completed, arrangements were made to 
administer them to the employes of cer- 
tain of the country’s largest industrial 
firms. The industries cooperating include 
the American Telephone and Telegraph 
Company, the Standard Oil Company of 
New Jersey, the Chicago and New Jersey 
branches of the Western Electric Com- 
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TABLE I 
GENERAL TEST PERCENTILES 
Civil High — 
No. of Errors Civil Civil Employes of Employes of Service School 
and Omis- Service Service Eight Industries One Industry Applicants Seniors 
sionson PerCent Eligibles Stenog- Typ- Stenog- Typ- Sten. and Stenogra- 
General Test Score S. & T. raphers ists raphers ists Typists phers Only 
pe 0 100 100 100 100 100 100 100 100 

5 98.5 99.5 99 100 100 100 100 100 

10 95 94 96 98 160 98 98 97 

15 90 81 83 97 79 98 93 94 

20 85 65 69 93 60 93 85 72 

25 80 46 56 82 42 88 71 63 

30 75 25 38 76 23 81 57 25 

35 69 6 30 60 15 70 42 19 

40 60 0 19 48 6 49 25 12 

45 Below 60 0 4 32 0 19 12 3 

50 Below 60 #) 3 22 0 14 s 3, 

55 Below 60 0 3 12 0 5 2 0 

60 Below 60 @) l 4 0 0 l 0 

65 Below 60 0 0 2 0 0 0 0 





By consulting the General Test percentile table here presented, the following relationships concer: 
ing a student who makes 25 errors on the General Test can be readily observed: (1) His performanc 


would earn a civil service score of 80 
civil service typist and stenographer registers. 
stenographers, etc 


(2) He is superior to 46 per cent of the eligibles on tl 


(3) He is superior to 56 per cent of industria 





pany, the Detroit Edison Company, the 
Ralston Purina Company, the R. R. Don- 
nelly & Sons Company, the Henry L. 
Doherty Company, and the stenographic 
forces of the Detroit Schools and others. 

The pupil's scores on the tests used 
in the schools will tell the pupil, as well 
as the teacher, how each pupil is pre- 
pared to meet actual requirements of po- 
sitions in Government or in industry. For 
example, the scores may indicate that a 
pupil’s accuracy in transcribing dictation 
given at 96 words per minute is greater, 
let us say, than that of 55 per cent of the 
stenographers in industry, and equal to 
the civil service passing score, but that 
his ability to use English is better than, 
let us say, only 30 per cent of those in 
industry. This information will be an in- 
centive if it is received by the student a 
year or more before the completion of 
his course—it is depressing when learned, 
as at present, at the employment office 
or on the job. 


The student can also be shown specifi 
cally how his qualifications compare with 
those of employes in various positions in 
various local industries. This information 
can also be transmitted advantageous; 
to the prospective employer. The school 
placement officer, or counselor, knowing 
the ability of the group of typical em 
ployes tested in that industry, can state 
the applicant's ability in such terms as 
“better than 80 per cent of your em- 
ployes in shorthand, better than 70 per 
cent in English,”’ etc. 

Let us assume that, having learned the 
reqirements of Government and industry, 
you wish to set a standard of instruction 
that will insure that your typists, as far 
as English usage in concerned, will rank 
among the top 50 per cent in industry 
It is a part of the project to provide the 
schools with charts which will permit 
them to set their standards. Chart 1 gives 
such information regarding English 
Usage. 
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Reading from 50 over to the line 
marked “Typists’’ and from there down 
to the base line, you find that the top 50 
per cent in industry make a score of 42 
points or better on the English Usage 
test. A minimum score of 42 on this 
test as a graduating requirement would, 
therefore, insure that all graduates rank 
with the top 50 per cent of typists in in- 
dustry in English Usage. Similar infor- 
mation in regard to stenographers shows 
that a score of 57 is equal to the average. 

Let us assume for a moment that a 
student makes a score of 60 items cor- 
rect on this test. In order to know how 
she compares with the people in a given 
industry, either for the purpose of de- 
termining whether or not it is more im- 
portant that she take additional work in 
English than in some other subject, or for 
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the purpose of informing an industrial 
firm how she compares with the people 
in that firm, as far as her command of 
English is concerned, we consult the chart 
which shows that the girl making this 
score is better than 67 per cent of sten- 
ographers in that firm, or in industry in 
general, depending upon the group on 
which the curve is based. 

Fifty per cent of the typists in this 
industry make scores between 33 and 52 
on the English Usage test. The middle 
50 per cent of stenographers lie between 
51 and 62 on this test. The percentile 
scores on the test are shown in Table II 

The percentile tables (on p. 32) show 
that the percentage of typists who receive 
low scores on the English Usage test is 
much larger than the corresponding per- 
centage of stenographers. For example, 70 
per cent of the typists answer 50 or fewer 
items correctly; only 20 per cent of 
stenographers fail to answer more than 
50 items correctly. 
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TABLE I] 
ENGLISH USAGE TEST: INDUSTRIAL PERCENTILES 

No. Items 5 "Percentiles No. Items ~~ Percentiles — 

_ Correct _ ___ Typists Stenographers Correct Typists Stenographx 
20 6.0 1.0 406 60.0 13.5 
21 7.0 1.5 47 63.0 15.0 
22 8.0 1.8 48 65.0 16.0 
23 9.0 2.0 49 68.0 18.0 
24 10.0 2.1 
25 11.0 2.2 50 70.0 20.0 
26 12.0 2.3 51 pf oe 25.0 
27 13.0 2:3 52 75.0 27.0 
28 14.0 2.7 53 eter 32.0 
29 15.0 2.9 54 80.0 35.0 

55 81.5 40.0 
30 17.0 3.0 56 83.5 45.0 
31 20.0 4.2 57 85.0 50.0 
32 22.0 3.6 58 87.5 $7.5 
33 25.0 3.9 59 90.0 60.0 
34 27.0 4.2 
35 30.0 4.5 60 91.0 67.5 
36 33.0 4.8 61 92.0 70.0 
37 35.0 5.0 62 93.0 75.0 
38 38.0 6.0 63 94.0 80.0 
39 40.0 6.5 64 95.0 85.0 

65 96.0 87.5 
40 45.0 7.0 66 97.0 90.0 
41 47.5 8.0 67 98.0 95.0 
42 50.0 9.0 68 99.0 97.0 
43 53.0 10.0 69 100.0 98.5 
44 55.0 11.0 
45 58.0 12.0 70 nee 100.0 








The English Usage test to which I refer 
has been constructed and standardized in 
a nation-wide survey sponsored by the 
Psychological Corporation. This test has 
been given to some 600,000 pupils from 
gtades 7 to 13, and grade norms are avail- 
able. The average high school senior 
answers 55.8 items correctly. Although 
the general stenographic test includes 
twenty grammar items, a number of 
schools and industries prefer to have a 
separate score on English Usage. 

The English Usage test was selected 
for use in the program of determining 
industrial and Government standards, be- 
cause the school norms are available and 


because a number of the firms which had 
given the Civil Service stenographic tests 
have also given this one to their em- 
ployes. 

If we wish to know the industrial 
standard with regard to the general adapt- 
ability test, we would be able to discover 
immediately by following the line on 
Chart 2 from 50 over to the curve and 
down to the base line, that in this case the 
minimum score would be set at 49. If, for 
example, an individual makes a score of 
43 on the general test, you would im- 
mediately know that she is better than 
38 per cent in industry, or in other words, 
that 62 per cent make better scores in 
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this test. Looking at the base line, you 
find that the middle 50 per cent in in- 
dustry range between 39 and 58. 

The general test comprises 80 items, 
40 items designed to measure judgment, 
reading ability, and knowledge of vocabu- 
lary, 20 designed to measure English 
usage, and 20 spelling items. A com- 
petitor for a Civil Service position is re- 
quired to answer 43 of the 80 items cor- 
rectly in order to receive a passing score 
on that test. 

On Chart 3 the bar at the left shows 
that in one of the industries, 85.10 per 
cent made scores above this passing mark. 
In the second industry, 48.78 per cent; 
in the third industry, 68.42 per cent. 

The fourth bar shows that 87.88 per 
cent of the employes serving as steno- 
graphers in a certain public school system 
score above this passing mark. It should 
be explained that no stenographer is ap- 
pointed in this system until she has had 
two years’ experience in industry. 

The fifth bar shows that 65.68 per cent 
of the Civil Service applicants make 
scores above this grade. In other words, 
those below the passing score, or 34.32 
per cent of the applicants are automatic- 
ally eliminated from further considera- 
tion. 

It will be seen that the applicants for 
Civil Service positions are about as good, 
as far as general test scores are con- 
cerned, as employes in industries. This is 
the first objective study that indicates the 
type of applicants that are competing for 
Civil Service positions. 

On Chart 4 the first eight bars indicate 
the typists in each of eight industries in 
which the general test was given. The 
height of the bar above the horizontal line 
indicates the per cent of the group pass- 
ing the general test and the part of the 
bar below the line indicates the per cent 
of the typists in each industry failing the 
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general test. The ninth bar represents 
all the industrial typists and the tenth 
bar represents present Government typ- 
ists. Civil Service standards have now 
been raised so that no new Government 
typist would be below the horizontal line 
representing the present Civil Service 
passing mark for junior typists 

Chart 5 is similar to the one preceding, 
but is based on industrial stenographer: 
It will be seen that in each of the indus 
tries the stenographers are superior to the 
typists. As in the preceding chart the 
ninth bar combines the first eight 
The tenth represents Government steno 
gtaphers, the eleventh represents Civil 
Service applicants, and the twelfth rep 
resents a commercial high school 

In so far as general test, spelling, and 
English are concerned, the persons who 
become eligible for Civil Service appoint 


ment, must make passing scores, and ap 
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pointments are made from the top of the 
register of eligible competitors. 

The seniors in one of the best com- 
mercial high schools in the country rate 
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somewhat above the average in industries 
on the general test. 

The first industry is again higher in 
rough draft, as shown by Chart 6, 76.59 
per cent passing; the second industry, 
which was lower in the general test, is 
also lower in the rough draft, 33.68 per 
cent passing. The industry which ranked 
third on the general test here ranks al- 
most equal to the first, with 76.04 pass- 
ing. The school system employes, who 
rated the highest on the general test, rate 
fourth on this test, with 57.58 per cent 
It will again be seen that Civil Service 
applicants make scores comparable with 
those of industrial employes. In the com- 
mercial high school, the average is con 
siderably above the average of industries 
in this requirement. 

Chart 7 shows the comparison between 
the combined standards of the industries 
and those of the high school referred to 
The black line indicates the high schoo! 
and the light line represents the indus- 
tries. It is evident at the left that the 


stenographic attainment in the business 
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high school is approximately equal to the 
standards in industries. It will be seen, 
however, that the per cent of applicants 
meeting the new Civil Service require- 
ments as to stenography is 28. Our 
standards were too high. 

On plain copy speed, it will be seen 
that again the standards of the business 
high school are about comparable with 
the ability of the people in industry. 

As far as accuracy in copying from 
plain copy is concerned, the industrial 
standard is somewhat above the business 
high school attainment. However, the 
industrial standard is 50 per cent lower 
than the Government requirement. 

In rough draft, the business high 
school standard is about equal to that of 
the industries. In the English Usage, the 
school’s standard is slightly higher than 
the industries’. 

It might be stated, however, that while 
industries are satisfied with the speed 
with which stenographers are able to take 
dictation, they are very much dissatisfied 
with the attainment in English usage. 
(The first two lines on Chart 8 referring 
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to stenography, indicate that the 96-word 
per minute speed is as high a speed as 
industries demand. ) 

Fewer than 6 per cent of those em- 
ployes in industries are able to pass the 
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120-word dictation test. Only 38 per cent 
can pass this specific 96-word test as 
administrated in this program. This in- 
dicates that beyond this 96-word-a-minute 
speed, schools might well give more at- 
tention to certain other phases of the 
curriculum. 

As a case in point, a study was made 
of approximately 100 stenographers who 
passed the 120-word test for entrance into 
an organization; when these stenographers 
were tested a year later, the majority were 
unable to pass the dictation test given at 
96-words per minute, showing that the 
120-word speed is excessive since it is not 
demanded in their actual work. 

A comparison of the relationship be- 
tween the general test scores and the ef- 
ficiency ratings of the employes of two 
industries cooperating in the studies, as 
shown in Charts 9 and 10, indicates that 
the new general test measures factors 
which the executives have in mind when 
they speak of “‘ability to use their heads.” 
These charts show that the new test is a 
definite step toward insuring that the 
stenographers and typists appointed as a 
result of the new examination will possess 
this ability. 

The coefficient of correlation between 


scores and efficiency ratings of the 51 em 
ployes tested in one industry was 0.71 
Of the 25 per cent who made the highest 
scores, approximately 90 per cent were 
above the average of the group in effi 
ciency. In another study on 80 stenogra- 
phers and typists of another large indus- 
try, a correlation of 0.76 was found be 
tween general test scores and efficiency 

On Chart 9 the vertical line at zero on 
the scale is the dividing line on either 
side of which fall 50 per cent of the 
efficiency ratings of the whole group of 
80 stenographers and typists. It will be 
referred to as the average. Each horizon- 
tal bar represents one quarter of the group 
tested. The top bar represents the em- 
ployes who made the highest 25 per cent 
of the test scores, hereafter referred to as 
Group A. The lowest bar represents 
those who made the lowest 25 per cent 
of the test scores, or Group D. In each 
bar, the part at the right of the vertical 
line indicates the percentage of that group 
rated above average in efficiency; the part 
at the left shows the percentage of that 
group rated below average. The solid 
white sections combined represent the 
most efficient 25 per cent of the total 
number of employes; the solid black 
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sections are the lowest 25 per cent in expected to be above average in efficiency 
efficiency. of the employes tested. In other words, 
The chart shows that of the employes the chances are 6 to 1 that their efficiency 
who made the highest 25 per cent of test will be above the average of the employes 
scores (Group A) 99 per cent were rated who are tested. 
above average in efficiency. Of those who 
made the lowest 25 per cent of test scores 
(Group D) only 4 per cent were rated 
above average in efficiency, 96 per cent Comparison of Comparison 
being rated below average. Cone Aremges cans ro 
This means, in terms of selection, that Jones 
practically all of those who made scores | Mary Jones 89 Rowst Deak a 
equal to those of Group A could be ex- Clara Carter 94 || General Test 8 92 
pected to be rated higher in efficiency than English Usage 84 
the average of the employes tested, where- 
as only 4 per cent of those whose scores TABLE II TABLE IV 
are as low as those of Group D would be 
rated above and 96 per cent would be eee "oe 
rated below average. A high general test | Below ore the test scores in cach subject 
score is thus actually indicative of apti- it ia m diows percent 
tude for the work. Rough Draft 77 82 
The differentiation made by the same Eoatish aol so 
test among the group of 51 employes of 
the other organization is shown on Chart 
10. The bars represent the same classifi- Suppose that Mary Jones and Clara 
cation of employes by scores as in the Carter have taken an examination con- 
preceding chart. sisting of tests in stenography, typing 
Of competitors who make scores equal from rough draft, English usage, and 
to those made by employes in Group A, general intelligence, spelling, etc. You 
the highest group, 86 per cent could be might choose between them on the basis 
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of their average scores as shown in Table 
III. You might do this because you be- 
lieve that a difference of five points on 
a good examination would clearly show 
which of the girls was better for any 
secretarial or stenographic position. 

From Table III, Mary Jones appears to 
be the girl for the job. But if you wanted 
to know more about the girls’ perform- 
ances than is shown by average scores, 
you might ask for the information given 
in Table IV so that you could see how the 
girls compared on each of the separate 
tests in the examination. 

Table ITV shows that Mary Jones is 
better in Rough Draft and Stenography 
than Clara Carter, but that Clara Carter 
is better in English Usage and Intelli- 
gence. You might decide now that it is 
more important for your prospective sec- 
retary to be intelligent than to be superior 
in anything else, and hence choose Clara 
Carter. But even if your problem were so 
simple, you really ought to know how 
each of the girls compares with steno- 
gtaphers in general, in order to know 
whether either of them is really superior. 


Table IV does not even give a good 
picture of how much better either girl is 
in any subject, because you don’t know 
what difference of ability is indicated by 
the difference in the scores in any one test. 

If you look at Table V, you will have 
a better idea of what various scores mean 
on the various tests, in terms of the per- 
centages of stenographers in industrial 
firms who get below each score. But al- 
though Table V gives you a better idea 
of the different meanings of scores on the 
different tests and tells you something 
as to how the girls compare with each 
other, you probably would find it diffi- 
cult to make a choice considering all the 
subjects as of some importance in a good 
secretary. 

One way of getting a better picture of 
the girls’ abilities is to prepare a chart 
which shows graphically most of the fac- 
tors to be considered. Chart 11 shows 
both the per cent of industrial stenogra- 
phers to whom each girl is superior in 
each subject, and how the girls compare 
with each other. The scale is distorted so 
that the horizontal distances between two 
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points are proportional to the differences 
in ability. We are able to see or to 
measure that, in total ability, as repre- 
sented by the distances to the right of the 
50 per cent line, the girls are exactly 
equal, if all subjects are equally import- 
ant. That is, Mary Jones’ superiority in 
stenography and rough draft is of the 
same extent as Clara Carter's superiority 
in English usage and intelligence. The 
five-point difference in average scores as 
given in Tables III and IV has no sig- 
nificance whatever. 

Note also that Clara Carter did better 
in stenography than Mary Jones did in 
the general test, although the scores 
would indicate a difference of nine points 
in the other direction. 

For the secretarial job, Clara Carter 
should prove superior, but it is also clear 
that Mary Jones is superior for a job in 
which stenography and rough draft are 
relatively more important than English 
and intelligence. 

Note that we are not ignoring differ- 
ences in ability in the less important sub- 
jects. We have simply determined for 


the specific example given that the differ- 
ences in the less important subjects are 
not large enough to out-weigh the dif- 
ferences in the more important subjects. 

This particular study was designed to 
bring about closer cooperation between 
Government, industries, and schools. It 
may well serve as an aid in the study of 
commercial curricula, involving the de- 
termination of industrial and Government 
standards in stenography, typewriting, 
English usage, and spelling’. Finally, it 
is suggestive of the type of work which 
will be necessary if we are to gear the 
processes of education to the needs of 
pupils in after-school life. It will be this 
type of data which the vocational educa- 
tor and the guidance counselor will come 
to employ in facilitating the adjustment 
of pupils in school—an essential step in 
preparing them to enter occupations for 
which they are really fitted. 


1 Copies of the tests referred to may be secured 
from the U. S. Civil Service Commission 


(Copyright by L. J. O'Rourke, 1934. Reproduced 
by permission of the author.) 
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OPULAR phrases are occasionally 
P= apt in their descriptions of 

technical procedures. The phrase, 
“fitting square pegs into square holes,” 
comes a bit too near describing some of 
the things done in the name of guidance 
to be entirely pleasing to the psychologi- 
cal ear. In popular discussions, and too 
frequently in the practice of educational 
institutions, only two kinds of pegs are 
considered: ‘‘round,’” and ‘‘square.”’ 
When the educational program and the 
youth prove to be poorly fitted for each 
other, the youth is promptly classified as 
being “round,” or “unprepared’’ for the 
square holes of the school, and is gently 
but surely eliminated. The realization 
that the human pegs supplied by biologi- 
cal nature and modern environment pos- 
sess hundreds of different shapes, and 
that most of them are decidedly worth 
preserving and using in the building of 
a modern social structure, has not yet 
come to many of those who are in control 
of the programs and procedures of edu- 
cational institutions. 

Another fact not recognized in this 
easily-spoken phrase is that the task of 
identifying the various characteristics of 
human beings is extremely complex and 
difficult. Nothing could be much simpler 
than the recognition of ‘‘squareness’” in 
a peg or in a hole, but few things are 
more complicated, multi-dimensional, and 
bewildering than the characters of human 
beings. If each hole in our industrial 


peg-board had been carefully surveyed 


and blue-printed, and each human peg 
had been carefully measured, classified. 
and labeled, the task of the vocational 
guide would be reasonably simple. As a 
matter of fact, however, success in a 
given job is dependent upon the posses 
sion, not only of the right combination 
of abilities, but also of the correct atti 
tudes, likes and dislikes, interests, per- 
sonality traits, social behavior, and the 
like. Among all of these, perhaps the 
individual's abilities and skills are most 
readily subject to objective measurement, 
and yet very little is yet known about the 
exact amounts of different kinds of abil- 
ity actually possessed by those persons 
who are working successfully and happily 
in different types of jobs. 

The information about occupational re- 
quirements most often quoted is chiefly 
of a subjective character. When a suc- 
cessful man is asked to enumerate the 
qualities that make for success in his 
field, he is more than likely, regardless of 
the field he represents, to name about the 
same list of adjectives. He is a very un- 
usual person if he does not include such 
qualities as honesty, intelligence, cour- 
tesy, aggressiveness, and loyalty. Where 
objective measurements have been made, 
however, it has been found that certain 
occupations require far less of a given 
quality than do others, and that in some 
occupations it is probably as much of a 
handicap to have a high amount of a cer- 
tain trait as to have little of it. For each 
occupation there seems to be required an 
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optimum degree of each quality, and this 
optimum is rarely the maximum degree. 
Instead of assuming that one needs the 
highest possible amount of a given char- 
acteristic in order to be successful, the 
vocational guide needs to know what de- 
gree of the characteristic is typical of 
successful workers in each different occu- 
pation. 

In order to determine how much of a 
given trait is possessed by a high school 
or college youth, or how much of it is 
possessed by successful workers in the 
occupation he is considering, it is neces- 
sary to use some scale or test which will 
reveal the strength of the trait in an index 
which can be verified by other examiners. 
The test must be so reliable that it will 
give approximately the same index, re- 
gardless of who administers it or when. 
A device which gives one index when 
administered by a high school teacher and 
an entirely different index when admin- 
istered by an employment office clerk is 
of little or no value for guidance pur- 
poses. 

It is not sufficient, however, to know 
that on a certain reliable test Student X 
made the same score as is commonly ob- 
tained by successful workers in the occu- 
pation he wishes to enter. A person 
might be exactly typical of successful 
clerical workers in his academic intelli- 
gence, for example, but be very different 
from them in other important character- 
istics. The possession of typical amounts 
of certain particular characteristics seems 
in each occupational field to be more im- 
portant than the possession of typical 
amounts of certain other characteristics, 
and the list of characteristics which are 
important seems to vary with the occupa- 
tional field. It is interesting to note, in 
this connection, that in such preliminary 
attempts as have been made to measure 
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the characteristics of successful workers in 
an occupation by means of a wide variety 
of tests, some of the tests which had been 
assumed to be important were found to 
be of relatively little value, while others 
which had been considered relatively un 
important were found to be quite signifi 
cant. A thoroughgoing program of scien- 
tific investigation is for the 
purpose of determining which tests are 


needed 


really significant and what amount of 
each trait is typical of the best workers in 
each occupational field. 

Figure 1 represents in a graphic way 
some of the differences in average scores 
between the “best” (A) and the “‘poor- 
est’’ (D) nurses in a group of more than 
300 who were measured by the Employ- 
ment Stabilization Research Institute at 
the University of Minnesota.'' The heavy 
perpendicular line passing through the 
center of this chart represents for each 
test the score made by the average adult 
woman. Along the base of the chart is 
a scale indicating, for a representative 
sampling of the total adult population of 
women, the percentages that normally 
make scores below the points indicated 
The two tests on which the best nurses 
showed the greatest superiority over the 
poorest were the education test and the 
test of strength in the right hand. In 
each of these tests the best nurses made 
an average score that was higher than 
ninety per cent of normal adult women 
usually make. The chart shows, on the 
other hand, that there was practically no 
difference between the good nurses and 
the poor nurses when measured by means 
of the Minnesota Mechanical Assembly 
Test, although both groups of nurses did 


1 Gordon, Phoebe. “Tested Qualities of Gradu- 


ate Nurses.” Proceedings of the Thirty-ninth An 
nual Convention of the National League of Nursing 
Education, June, 1933, pp. 184-190 
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better on this test than seventy per cent of 
the normal or standard group of women. 

The four lowest scales in Figure 1 rep- 
resent the results obtained from applying 
Bernreuter’s Personality Inventory. A 
high score, represented on the chart by 
distance to the right of the mean, is sup- 
posed in BN1 to indicate “nervous sta- 
bility,” in BS2 “self-sufficiency,” in BI3 
“extroversion,” and in BD4 ‘“domi- 
nance.” It appears from the results pre- 
sented in Figure 1 that there are rela- 
tively small differences between these 
“best’’ and “poorest” graduate nurses 
when measured by Bernreuter’s test, and 
that the averages of either class are not 
very different from the averages of wom- 
en in other occupations. 

It is possible, of course, that there are 


many other tests on which the best nurses 
would differ even more than they differ 
on these tests from the poor nurses or 
from the average woman. Until further 
research has indicated what these better 
tests may be, however, one is justified, so 
far as tested general fitness is concerned, 
in giving encouragement to girls who 
wish to enter nursing training, if they are 
found to possess slightly better than aver- 
age scores on the Minnesota Vocational 
Test for Clerical Workers and on the 
O'Connor Tweezer Dexterity Test, to- 
gether with strength in the hands and 
academic intelligence superior to about 
90 per cent of adult women. It would 
seem unnecessary, from the results indi- 
cated in Figure 1, to use the Bernreuter 
Personality Inventory, since the differ- 
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ences between the “‘best’’ and the “‘poor- 
est” nurses are so slight. The Minnesota 
Mechanical Assembly Test appears to 
have some value in separating nurses 
from other women, but it seems to be 
useless in separating good from poor 
nurses. 

Figure 2 represents the scores made by 
two groups of women in each of three 
different occupations: saleswomen from 
two different department stores, private 
duty nurses and public health nurses, and 
clerical workers in public school offices 
and in a life insurance office. It will be 
observed in the academic intelligence or 
“education test’’ the public health nurses 
made the same average score as the school 
clerks, both being slightly higher than 80 
per cent of adult women in general. A 


vocational guide would scarcely be justi 
fied, according to these results, in using 
school grades or scores on “intelligence 
tests” as a basis for giving advice to a girl 
who was trying to decide between clerical 
work and public health nursing as a ca- 
reer. The differences between the abili- 
ties of the women in these two occupa- 
tions are extremely significant, however, 
when measured on the Minnesota Voca- 
tional Test for Clerical Workers. It is 
possible that later research may develop 
tests on which the differences between 
workers in these two occupations will be 
greater than they are on this one, but at 
the present time this simple clerical test 
seems to be the most helpful single test 
available for making this distinction be- 
tween clerical workers and nurses. 
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Vocational guidance should not be 


given on the basis of a single test, how- 
ever, for the attainment of success in an 
occupation is dependent upon having the 
right combination of various characteris- 
tics rather than upon the possession of 
one or two good traits. For example, a 
girl might have all of the measured traits 
of the typical saleswoman represented in 
Figure 2, but be too frail in physical 
health to be able to accept employment 
in a department store. She might be 
quite typical of the saleswoman in her 
abilities, mental and physical, in her likes 
and dislikes, in her attitudes and inter- 
ests, and in her personal ambitions, but 
be a member of some family in which the 
social traditions were all against such 
work. Vocational guidance should be 
based upon all of the data available re- 
garding the individual's present situation, 
plus as much as is obtainable regarding 
the manner in which he has developed 
into his present status. The more objec- 
tive and reliable the evidence on these 
points, the more dependence one may 
place upon them. 

Graphic representation of the scores 
obtained on a series of tests is made pos- 
sible by employing a common unit of 
measurement—in these figures, the stand- 
ard deviation or sigma of a normal adult 
population. Any other statistical meas- 
ure of dispersion in such a group might 
be used equally well. The essential re- 
quirement is to have a fairly complete 
sampling of the distribution of scores 
made by a normal adult population. 

There are a number of advantages in 
the graphic presentation of test results. 
One of these is the ease with which the 
eye and mind can grasp the relationships 
to each other of the results in different 
fields. It would take several pages of 
this magazine to explain fully the rela- 


tionships revealed at a glance in Figure 2 
and after reading these pages the averag: 
person would probably remember less 
about the relationships than he would 
from examining the graphic figure for a 
few minutes. Furthermore, it seems 
probable that comparisons of six different 
average scores in each of seven or eight 
different tests would be rather uninter 
esting to most people if presented in a 
statistical table. It is possible, however 
that many readers of Occu pations—T he 
Vocational Guidance Magazine will be 
more interested in observing how much 
lower the ability scores of the sales- 
women are in the chart than the scores of 
the clerical workers, and the extent to 
which in the Bernreuter Personality In- 
ventory the saleswomen showed higher 
average scores than the clerical workers 
in “stability” (BN1), ‘‘self-sufficiency’ 
(BS2), “extroversion’” (BI3), and 
“dominance” (BD4). Seeing the rela 
tionships between the records of different 
occupational groups on the same test, and 
especially between the scores of the same 
group on different tests, enables one to 
think more definitely of relationships, as 
such, than he could if numerals only were 
reported. 

It must be admitted, however, that 
there are dangers in the graphic presenta- 
tion of test scores. As in all other efforts 
to give a popular interpretation of a 
scientific phenomenon, there are dangers 
of over-simplification and misinterpreta- 
tion. Some readers might easily get the 
impression from Figure 2 that all sales- 
women showed less ability in the clerical 
and education tests than any nurse. This 
was not true. The lines in the graph 
represent average scores, only. Others 
might arrive at the false conclusion that 
the Minnesota Spatial Relations Test was 
more important in distinguishing between 
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saleswomen and clerical workers than the 
Manson Occupational Interest Blank for 
Women, since the results of the interest 
blank do not appear on the graph. The 
mere presence of a given test in a graphic 
representation may tend to lead uncritical 
observers to believe that it was consid- 
ered equal in significance to the others 
which appear, and superior to those 
which do not appear. As a matter of 
fact, however, some of the most impor- 
tant data for use in the guidance of an 
individual cannot readily be included in 
a graphic record. Furthermore, repre- 
senting a fact graphically does not in it- 
self increase its predictive value, its val- 
idity, or its reliability in the least. 

In spite of these and other dangers of 
misinterpretation, the “test profile,” or 
graphic representation on a common scale 
of the different scores of an individual or 
of a successful occupational group, does 
call attention to some of the relation- 


ships that exist among the scores in dif 

ferent types of tests, and these relation- 
ships and patterns of ability have a 
vocational significance which is some- 
thing over and above the mere sum of 
the significances possessed by each test 
score individually. Such graphs may sug- 
gest when it is desirable to determine, 
although they do not in themselves di 

rectly indicate, the seriousness of an indi- 
vidual’s deviations from the typical trait 
pattern of successful workers in the field 
to which he aspires. When considered 
as tools, to be used along with other tools 
and statistical devices for obtaining and 
presenting useful data about individuals 
and groups of individuals, test profiles or 
patterns can serve very useful purposes in 
guidance. If they were to be considered 
as ends in themselves, however, or as the 
only method of evaluating test scores in 
guidance work, they would not be worth 
the effort required in their preparation 
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HERE is much popular discussion 

; today about occupational ability 

patterns. The objective of the 
pattern is commendable; the theory, so 
far as we know, is fundamentally sound; 
but the application of the theory to the 
construction of patterns for immediate 
use implies assumptions which merit criti- 
cal appraisal.’ 

Those who have done the most work 
on patterns are fully aware of their limi- 
tations and of the careful validation 
which must be completed before they can 
be used generally in practice.? Those who 
are less familiar with them may, in their 
enthusiasm for something new, overlook 
the obvious limitations, proceed at once 
to base their counseling upon unvalidated 
patterns, or dissipate their energies upon 
inadequate attempts to construct new 
ones. Henry Suzzallo once exclaimed, 
“God save us from our disciples!” It is 
in the hope of serving the disciples as 
well as the masters that we endeavor here 
to suggest some of the limitations of pat- 
terns in their present form. 


II 
Every public discussion of patterns 


1In attempting to explain the errors which 
novices may make, it has been difficult to avoid 
giving the impression that some of the same errors 
are made by those pioneer psychologists whose 
vision is responsible for this significant new de- 
velopment in diagnostic technique. Any such im- 
pression would be most unfortunate. 

2 Cf. Trabue, M. R.: “Occupational Ability Pat- 
terns,” Personnel Journal, 1933, 11: 344-351. 


seems to elicit from someone the criti- 
cism that the tests on which the patterns 
are based are of such low reliability and 
validity* that they should not be used for 
individual diagnosis; and the familiar re- 
ply that “the important thing is not the 
score on any one test, but the relationship 
among the test results.” This may be an 
adequate answer, or it may not. We can- 
not logically assume its adequacy until 
we have more evidence than has yet been 
published. 

To illustrate by analogy, consider the 
well known fact that single items on a 
test of intelligence have nowhere near 
the validity of the test as a whole, and 
the equally familiar fact that the reliabil- 
ity of a test can be increased by adding 
more items of equal quality. An intelli- 
gence test is always validated against its 
criterion, and its final reliability is always 
determined, after the items have been 
combined. Bitter experience has revealed 
that, in many cases, validity and reliabil- 
ity both prove to be lower than was 
anticipated. No maker of occupational 
patterns may neglect the final step of de- 
termining validity and reliability. With- 


8 “The reliability of a test (or any other measur- 
ing instrument) is determined by the consistency 
with which it measures the capacity of those 
taking it."—Garrett, H. E.: Statistics in Psychol- 
ogy and Education, New York: Longmans, Green, 
1926, p. 268.) 

“The validity of any measuring instrument 
depends on the fidelity with which it measures 
whatever it purports to measure.” (Ibid., p. 266.) 
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out adequate validation* against a satis- 
factory criterion no pattern may be as- 
sumed to be any better than the tests 
upon which it is based. It might even, 
through the contamination of poor tests, 
be less useful than some of the single 
tests in the battery. 


Ill 


Graphic charts have frequently been 
used to illustrate the idea of occupational 
patterns. Each chart depicts the median 
and quartile scores* made by successful 
people in one occupation on a battery of 
aptitude, personality, and intelligence 
tests, et cetera. The median scores on all 
of the tests are connected by a line which 
usually follows a zigzag course from the 
top to the bottom of the chart. The quar- 
tile scores are connected by similar lines. 
The chart thus represents the central ten- 
dency of the scores of many individuals. 
When the scores of one person are plot- 
ted separately, the chart is called a “‘pro- 
file.” There is much more to the pattern 
idea than just a simple chart of this kind. 
But to the counselor who is trying to ad- 
vise someone interested in the occupation, 
it looks like a simple and useful pro- 
cedure to compare his profile with the 
chart and then to see how well he fits. 

This reasoning implies the assumption 
that the profile of an individual should 


* Adequate validation requires the comparison 
of predictions made from patterns with the subse- 
quent success of persons who sought the guidance 
of patterns and acted upon it. A tentative valida- 
tion may be made by comparing the pattern with 
the profiles of a large number of successful indi- 
viduals who were sof used in constructing the 
pattern. We have, unfortunately, seen some at- 
tempts to construct patterns and use them without 
undertaking either kind of validation. 

5 The first quartile is the point below which 
one-fourth of the cases fall. The third quartile is 
the point below which three-fourths of the cases 
fall. Between these points lies the “inter-quartile 
renge,” which includes the middle fifty per cent 
of the cases. The median is the mid-point in any 
distribution of scores. 


{ 47 ] 


follow the median scores (or at least be 
within the range of the middle fifty per 
cent) of successful people as shown on 
the pattern if he is to enter the occupa 
tion and succeed in it. To reveal the 
fallacy in this, consider a hypothetical 
case. Suppose we are constructing a test 
battery to be used in determining an oc- 
cupational pattern for portrait painters, 
and that we decide to include in it a test 
of radicalism-conservatism in art. It is 
not unreasonable to suppose that very 
conservative portrait painters would find 
a market for their product among con- 
servative buyers. Radical painters like- 
wise might find a good market among 
buyers of radical preferences. But the 
middle-of-the-road man, who could never 
quite make up his mind whether to be 
radical or conservative, would be more 
likely to paint a hodgepodge which no 
one would buy. 

Now notice, that if our group of suc- 
cessful painters should include about the 
same number of radical and conservative 
men the median score would be that of 
the rare individual who is in the middle, 
and whose success may be due wholly to 
some accidental factor which would favor 
only one in a thousand. Yet it is this 
very score which our chart might lead us 
to think is the optimum. We would 
thus make the unforgivable mistake of 
guiding into this occupation the very per- 
son who has the least chance of succeed- 
ing. The same thing might happen in 
the case of any number of tests in a bat- 
tery, so long as the chart is based on any 
kind of average scores. 


IV 


Another dubious assumption is very 
apt to be made by those who like to take 
their technical knowledge graphically be- 
cause they have been denied the time or 
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the inclination to study statistics. They 
are, quite naturally, impressed by the 
fidelity with which the zigzag lines, con- 
necting the scores at the first and third 
quartiles on the pattern, follow the direc- 
tion taken by the line which connects the 
medians. To the neophyte this seems to 
reveal some sort of internal consistency 
in the pattern; and, he reasons, why is it 
so consistent if there is no meaning in it? 
The answer is simple. If we plotted the 
scores at the 49th and 51st centiles* we 
would expect to see them follow very 
closely the scores at the median or 50th 
centile. Likewise, if we plotted the 48th 
and 52nd; or the 47th and 53rd. It is 
inherent in any fairly normal distribution 
that the bulk of the cases, including the 
quartiles, should move up or down the 
scale in the same direction as the median. 
That the zigzags of the quartiles will re- 
semble those of the median is predeter- 
mined by definition before the chart is 
even drawn. The fact that they do so is 
no more significant than the fact that the 
mean is somewhere near the median in 
most distributions. Only in the case of 
a skewed or bi-modal distribution (such 
as that described above in the hypotheti- 
cal case of the portrait painters) would 
either of the quartiles spread very far 








® A centile is a point below which a given per 
cent of cases fall. Thus 49% of the cases fall 
below the 49th centile, 51% below the Sist 
centile, and so on. 


apart from the median. Even in such a 
case, the nature of the distribution would 
not change the general direction of the 
pattern if the modes happened to be both 
above the 50th centile, while the ms 
dians and quartiles of the tests which 
precede and follow this one are some 
The apparent in- 
ternal consistency of the pattern is there- 


where below the 50th. 


fore meaningless as an indication of 
diagnostic validity. 


V 


Are occupational patterns then a will 
o’-the-wisp? Not at all. Instead, they are 
a very promising development. But they 
must be allowed to develop and to dem 
onstrate their validity in experimental 
applications before the “working coun 
selor’’ may place in them the faith whic! 
some naive counselors now have. Experi 
mentation in practical applications, if 
properly controlled to assure opportunity 
for validation, is to be encouraged; not 
only because we may discover something 
of immediate practical value, but also be- 
cause attempts to develop patterns may 
disclose weaknesses in available aptitude 
tests and lead to basic improvements in 
the separate instruments of measurement 
Such work, however, must be regarded as 
experimentation, not as the application to 
daily problems of a technique which has 
proved its worth. 
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HETHER a man has the interests 

of an engineer, lawyer, account- 

ant, etc., is determined by the 
Vocational Interest Test. It is assumed 
that a man will be more effective in his 
vocational career if he is engaged in work 
that he likes than if he is forced to do a 
great many things that he dislikes. Other 
factors must, of course, be considered in 
choosing a career; but what a man likes 
and also what he dislikes play an impor- 
tant rdéle. 

The Vocational Interest Test? is an 
eight-page blank listing 420 items, to 
each of which the individual responds by 
indicating whether he likes it, dislikes it, 
or is merely indifferent to it. The first 
page provides opportunity for the indi- 
vidual to record significant information 
as to his education, jobs held, occupa- 
tional plans, etc. 

The test is designed for males, 15 years 
of age and over. (A companion blank 
for females has been printed. Stencils 
for scoring the women’s blank are in 
process of development but will not be 
issued for some time.) The blank for 
men can be scored for interest in 27 oc- 
cupations (listed in Table II); also for 
interest maturity, which records the ma- 
turity of interest of the individual in 
comparison to others of the same age. 


II 


Of what significance are interests? 





1 Requests for samples of the blank and in- 
quiries as to cost of blank and stencils for scoring 
should be addressed to Stanford University Press, 
Stanford University, California. 
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If a boy likes mathematics, physics, and 
chemistry and dislikes English, he will 
most likely decide to be an engineer. On 
the other hand, if he dislikes the first 
three subjects and likes English, and 
in addition, he likes to talk, he will plan 
to be a lawyer. Decisions of this sort are 
made today because teachers and friends 
interpret such interests to mean engineer 
ing in the first case and law in the second 

As an actual fact the first combination 
fits about equally well the occupations of 
farmer, engineer, chemist, dentist, archi 
tect, mathematician, physician, physicist 
and psychologist, and the second com 
bination is expressive of the early inter 
ests of those who later become not only 
lawyers but also newspaper editors, au 
thors, advertising men, and salesmen of 
life insurance and real estate 

The above illustrates the fact that 
young people have always been given vo- 
cational counsel in terms of their ex- 
pressed interests. It illustrates the fur 
ther fact that amateur counselors have 
been perfectly willing to base their advice 
on one or two evidences of interest and 
usually have not doubted their ability to 
interpret such interests in terms of occu- 
pational careers. 

The more one studies the problem of 
vocational guidance the more one is im- 
pressed with the complexity of the sub- 
ject. Space is not available here to dis- 
cuss the various difficulties involved. 
Fortunately, they are treated by others 
in this series of articles. Our primary 
concern now is the relationship of inter- 
ests to occupational choice, though we 





OCCUPATIONS 


must not forget that this is only one of 
many factors that must be considered. 
Various investigators have made clear 
that a boy’s expressed choice of his future 
occupation is very apt to change from 
year to year. We are not here concerned 
with such choices; instead, we are con- 
cerned with ‘‘the sum total of all interests 
that bear upon an occupational career.” 
When over four hundred separate inter- 
ests are taken into account, we find that 
there is surprising stability of interests 
among adults* and that, although there 
are some changes from 15 to 30 years of 
age, on the whole the general pattern of 
interests continues throughout life.* 
Table I illustrates what is meant by a 
pattern of interests. The average engi- 
neer, for example, would dislike to be an 
actor, advertiser, or artist, is indifferent to 
being an army officer, but would like to 
be an architect. The other five occupa- 
tional groups mentioned in the table have 
characteristically different patterns of 
these five occupational items. The six 
occupational groups differ also with re- 


2E. K. Strong, Jr. Change of Interests With 
Age, Stanford University Press, 1931. 

SE. K. Strong, Jr. “Interest Maturity,” Person- 
nel Journal, August, 1933; also forthcoming 
article in same journal entitled “Classification of 
Occupations on Basis of Interests.” 


spect to liking and disliking the schoo| 
subjects they studied. The pattern of in. 
terests discussed here is based upon 42 
items, not merely upon the ten items 
given in Table I. As a result of analyz. 
ing the interests of men in over thirty 
occupations we know that each occupa- 
tional group has a characteristic set of 
likes and dislikes that differentiates it 
from other occupational groups. 


Ill 


Occupational groups are not, however 
all equally different from one another in 
this respect. The interests of engineers 
and chemists are nearly alike (correlation 
corrected for attenuation is .95). Simi- 
larly the interests of life insurance and 
real estate men are nearly identical. Oc- 
cupations can be grouped according to the 
interests of the men to be found in the 
occupations. Such grouping is not based 
on similarity of activities performed in 
these occupations, although in the main 
there is considerable similarity within any 
group. It is based entirely on the simi- 
larity of interests possessed by men in the 
occupations. 

Table II presents the grouping of 28 
occupations into five main groups, two of 
which are subdivided, making seven 


TABLE I 
TypicaL Likes (L), INDIFFERENCES (1), AND Distikes (D) oF 
Srx OCCUPATIONAL GROUPS 











Life 
Insurance Personnel 
ITEM a Engineer Lawyer _Salesman__Minister Manager Accountant 
DCS at ods ces e bs aweu D L D L L I 
BP Peay ape ee D D L L I I 
A L D I L I D 
Army Officer ..........5. I L I D L I 
[A Se? Spare D D D L I D 
I <6 6 060-005 Sadccece L D D I D ZL 
ee I D L L I I 
+. oes esses cs L D D D L L 
aes is dda baves oboe +6 I D I I I D 
PED on ascen dasiea we I L L L I D 
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THE VOCATIONAL INTEREST TEST 


TABLE II 
CLASSIFICATION OF OCCUPATIONS IN TERMS OF INTERESTS 





Group Octane*® Occupation 


Factor Loadings 


No. 1 No. 2 No. 3 No. 4 N 






































I 1 RE ee 561 —.569 .578 
I 1 SE 66 6464 ee eeaeseneeae 389 515 641 270 052 
I 1 Farmer ... 320 .250 .675 112 182 
I 1 Mathematician 561 .716 142 —.024 150 
I 1 SEE 6ransbo cetvsadeswes 458 .754 404 055 142 
I 1 DT sic atsdudadaeowe es .574 .614 099 —.236 617 
I 1 Dentist . 486 —.494 443 121 8 
I 1 Physician 381 793 062 152 . 
I 1 Carpenter .400 004 795 07 17 
] 4 Psychologist .560 640 056 354 305 
I 4 ae olla itis cn tk oes Me 140 790 —.267 324 61 
lA 8 DE i cecdvebeeattwbouss —.124 279 835 177 
ITA s 0 eS ee ee -,223 134 785 02 
IA 8 Ee eee ee 496 169 750 074 155 
IIB 7 Life insurance salesman... . 429 925 113 7 0 
IIB 7 Real estate salesman 638 360 315 i 7 
IIIA 3 SD nk. sg eo ae ca a Ser a ta 530 236 —.40 5 145 
IITA 3 Teacher 825 266 156 2 “ 
IIA 2 Musician 437 079 089 561 
IIIB 3 Personnel manager ........... 274 741 -.042 .104 
Ip 3 City school superintendent. . . 545 530 —.505 Or 
IIIB 3 VGA, secectary ......... 433 .774 .240 320 
IIIs 2 Y.M.C.A. physical director 400 691 .163 3 g 
IV 2 SS RR See 217 563 428 {87 
IV 2 i 091 818 403 195 
IV 6 Purchasing agent ............ 084 333 .516 74 ; 
IV 6 Vacuum cleaner salesman...... -.109 896 .205 ( 11 
V 3 Certified public accountant... . . 148 090 —.261 493 380 





® See footnote No. 5 in text. 








groups all told. This classification is not 
to be viewed as complete. As additional 
occupations are added to the list, the 
grouping will be modified somewhat, but 
in the main the classification will prob- 
ably remain as at present. The basis forsuch 
a classification is illustrated in Figure 1. 

Using Thurstone’s technique of factor 
analysis,‘ five independent factors are ob- 
tained in terms of which the various oc- 
cupational interests may be expressed. 


*L. L. Thurstone, “The Theory of Multiple 
Factors,” Psychological Abstracts, July, 1933, Entry 
3091; L. L. Thurstone, “A Simplified Multiple 
Factor Method,” Psychological Abstracts, Septem- 
ber, 1933, Entry 4171. 
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The loadings for these factors are given 
in Table II for each of the 28 occupa- 
tions. If the second and third factor 
loadings are plotted, we obtain the cen- 
tral portion of Figure 1. Thus YMCA 
secretary has a second factor loading of 
+.774 and a third factor loading of 
—.240 placing it in the upper left hand 
corner of the diagram. If the first factor 
loadings are also considered, the three 
coordinates locate occupation in 
three-dimensional spaces. To determine 
whether an occupation is located above or 
below the plane established by factors 
two and three, note whether it is given 
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THE VOCATIONAL INTEREST TEST 


at the extreme right or extreme left of 
the figure; to determine how far it is 
above or below the plane, note how far it 
is located from the right and left edges, 
respectively, of the central portion of the 
figure. Thus life insurance is located 
.433 units below the plane while city 
school superintendent is .545 units above 
the plane. Although at first glance these 
two appear in the central part of Figure 
1 to be located very near each other, it is 
evident that as regards factor one they 
are .978 units apart. (It is largely for 
this reason the correlation between the 
two is only .224.) 

These seven groups of occupations may 
be likened to constellations of stars. 
Group I is located near the upper surface 
of a sphere in octane’ No. 1; Group Ila 
is near the under surface in octane No. 8; 
Group IIb is also on the under side of 
the sphere in octane No. 7. Groups [Ila 
and IIIb, with the exception of YMCA 
physical director, are near the upper sur- 
face in octane No. 3; Group IV is in 
octanes 2 and 6; Group V is located not 
far from the center of the sphere, within 
octane No. 3. 

As five coordinates (factor loadings) 
are necessary to locate the position of each 
occupation the true relationships can only 
be expressed in terms of five-dimensional 
spaces. As this cannot be shown in a 
diagram it is necessary to draw several 
diagrams, similar to Figure 1, giving 
varying combinations of the five factors. 
Actually, however, the general relation- 


SIf a sphere is trisected by three planes, per- 
pendicular to each other, there result eight seg- 
ments (octanes). Looking down upon such a 
sphere there are visible four octanes. These may 
be referred to by number: No. 1 is the octane to 
the right toward one; No. 2 is to the right but 
away from one; No. 3 is to the left and away 
from one; No. 4 is to the left and toward one. 
The four octanes underneath may be similarly 
numbered in counter-clock order so that No. 5 is 
underneath No. 1; No. 6 is underneath No. 2, etc. 
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ships between the occupations are shown 
quite well in Figure 1. This is true be 
cause factors four and five are of less sig- 
nificance than the first three factors 
What is the significance of these rela 
tionships? Or in other words, of what 
value is the grouping of occupations as 
set forth in Table Il? As far as inter 
ests go, one may expect a man to change 
from law to journalism or to advertising 
or vice versa since the interests of men in 


these occupations are closely related, 
thus:— aes. 
Raw C for 
eficient Att tion 
Correlation, law and journalism 81 88 
law and advertising 69 77 
journalism and ad- 
vertising .. 81 gg 


Similarly, the interests of men in farm 
ing, engineering, chemistry, 
physics, mathematics, architecture, medi- 
cine, and psychology are very much alike 
To change from one to another is not at 
all unusual. But a change from any one 
of them to law or writing represents a 
very great change. 

Second, with the use of the interest test 
it is possible to determine in which occu- 
pational group a man’s interests fall. For 
vocational guidance in high school and 
even junior college this determination is 
usually sufficient and often is preferable 
to vocational guidance in terms of specific 
occupations. Thus if a boy believes he is 
going to be a chemist, it will be much 
more difficult to interest him in laying a 
broad foundation for his career than if he 
believes he will eventually specialize in 
some one of the sciences but does not 
know which one. 
changes in industrial and professional life 
it is folly to prepare for a narrow spe- 
cialty because it may disappear overnight 
The young man who spends a portion of 
his time studying physics, mathematics, 
and physiology, and consequently less 
time upon chemistry, is much more likely 


dentistry, 


In view of the rapid 
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to succeed as a chemist than another who 
devotes all his time to chemistry. 


IV 


How permanent are these patterns of 
interests which are measured by the Vo- 
cational Interest Test? The evidence is 
clear that they are very stable from 25 to 
55 years of age. The evidence is also 
clear that there are real changes from 15 
to 30 years of age. To a large degree 
this is due to the development during 
later adolescence of interests typical of 
occupations in Group III (see Table II). 
Because of this fact 15-year-old boys who 
will eventually enter teaching, the min- 
istry, and related activities are not likely 
to select these occupations at that early 
age, and their interest ratings are likely 
to be much lower at 15 than at 25 years 
of age. Although there are these changes, 
nevertheless interest patterns are really 
surprisingly stable, as is shown by the 
high correlations in Table III expressive 
of permanence of vocational interests for 
one- and five-year periods. 

The conclusion which many have 
reached that there is little reliability in a 
boy’s declaration that he is going to be an 
engineer or lawyer is to be accepted, but 
this does not mean that his interests 


change without rhyme or reason. The 
sum total of his interests remains surpris- 
ingly constant, as Table III indicates 
What does change greatly is the boy’s in- 
terpretation of his interests in terms of 
vocational choice. This is to be expected 
because he is in no position to know the 
significance of his varied interests or their 
relationship to occupational activities. It 
is just here that the Vocational Interest 
Test has its chief merit, for it interprets 
one’s interests in terms of occupations. 


V 


After a man’s blank has been scored 
the numerical scores are expressed by the 
ratings A, B+, B, B—, and C. A rating 
of A means the man has the interests of 
that occupational group; a rating of C 
means he does not have the interests of 
the men in that occupation. Ratings of 
B-+-, B, and B— are intermediate; they 
mean he probably has the interests of the 
occupation, but we cannot be so sure of 
it as we can when he receives an A 
rating.® 

Table IV records the ratings in 17 oc- 
cupations for seven Stanford University 

®See Manual for further discussion as to the 
meaning of these ratings. Manual for Vocational 


Interest Blank, by E. K. Strong, Jr., Stanford Uni- 
versity Press, Stanford, Calif. Price, 5 cents. 


TABLE III 
PERMANENCE OF VOCATIONAL INTERESTS FOR ONE- AND FIVE-YEAR PERIODS. 
SAME INDIVIDUALS TESTED TWICE. 














{ee —Five Years———— 
Freshmen vs. Seniors Same Cor- 
11th vs. 12th Sophomores in 1927 rected for 
Grade* in College vs. 1932 Attenuation? | 
ee oO eae aa 100 247 223 223 
BNET ED hb: 0.0 00's 04 500009% .828 .906 844 .898 
EE ED ics seeene sy eaweus .726 845 .778 .880 
I os ds ech cdséceieresses, se .753 .769 857 
ie bb k ono 0 heh .678 .786 .643 .702 
|. TCO LEE ETE 721 .822 .759 834 





* Internal evidence suggests that a small minority did not take the task of filling out the blank seriously 
or else that there is surprisingly high permanence of interests at this age for most boys and very little per- 


manency for the remainder. 


> The average reliability of 27 occupational scales is .878 (odd-even technique). 
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TABLE IV 
INTEREST TEST RATINGS ON 17 OCCUPATIONS FOR SEVEN 1927 COLLEGE SENIORS 
Don't 
Vocational Choice in 1927 Medicine Engineering Law Know 
Sure of Choice............ Yes No Yes Yes Yes Yes 
Code Number ............ 205 214 269 256 225 209 226 
| ener A Cc A A C Cc C 
Engineering .............. A B— A B+ B— Cc C 
I as dnd ss os sean A B+ A B # & Cc 
eee B— B G = Cc Cc Cc 
sc bee aaeeet A Cc % c B Cc Cc 
MED cnc ccnauveewa Cc C ¢ ¢ Cc Cc Cc 
neck eck a Civbwwe & Cc os Cc B+ A - 
ere Cc Cc ¢ C B+ B+ B 
Advertising .............. Cc Cc Cc C Cc B— B— 
Life insurance ............ Cc - C Cc € Cc is 
ws cc wee veces Cc ] ¢ * C B— B+ 
0 PP re er Cc as = Cc * [ Cc 
2 EE eee ee B A c oR e 6 
i SE ee Cc Cc Cc Cc i Cc * 
aaa he doll “ B— B Cc Cc B+ Cc 
ee B B B B Cc B B 
Public accounting ......... C Cc Cc C B— B+ . 
Salesman 
Vocational Choice in 1932 Medicine Chemistry Engineering Law Steel Products 





seniors of the class of 1927. Follow-ups 
of these men have been made in 1928, 
1929, and 1932, so that we know with 
considerable accuracy what they have 
done to earn a living since graduation. 
No. 205 reported on the first three occa- 
sions that he was planning to go into 
medicine, a decision he says he made in 
1921. Prior to that time he had consid- 
ered civil engineering. In 1932 he was 
practicing surgery in a hospital. His in- 
terest ratings are A in farming, engineer- 
ing, chemistry, and medicine. His voca- 
tion today is in harmony with his interests 
in 1927. 

No. 214 did not know in 1927 what 
he was going to do (his major had been 
chemistry); in 1928 he was sure of medi- 
cine as his choice; in 1929 he was work- 
ing for an M.A., in education in order to 
earn money by teaching to attend a med- 
ical school and reported he was fairly cer- 
tain the latter course was the proper one 
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for him. In 1932 he had a position as a 
chemist with which he was “pretty con- 
tent’’; at the same time he suggested he 
might return to college and “‘study medi- 
cine, biochemistry, or bacteriology.” Ac- 
cording to the interest test in 1927 his 
strongest interest was chemistry with psy- 
chology, teaching, and purchasing next. 
In medicine he rated C. 

No. 269 is a typical civil engineering 
student who had planned on this career 
since 1921. Im addition he had day- 
dreams of ranching and architecture. His 
present position in engineering is in 
agreement with his interests as deter- 
mined in 1927. No. 256 had also 
planned for some time to be an electrical 
engineer and is engaged in radio engi- 
neering today. According to his 1927 
interests farming should be his first 
choice and engineering second. No. 225, 
on the other hand, has alternated between 
mining, engineering, and law, preferring 
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the latter in 1928. But in 1929 he had 
switched back to mining. In 1932 he 
had a position as a mining engineer. He 
reported in 1928 and 1929 that he was 
studying English and writing. The in- 
terest ratings of B+ in journalism and 
law and only B— in engineering suggest 
that his avocation of writing articles and 
stories may supplant his present vocation. 
A further follow-up in 1937 will pos- 
sibly settle the question as to the potency 
of early interests in determining this 
man's career. 

In 1915 No. 209 was planning to enter 
law; in 1924 his aim was the brokerage 
business; in 1926 and 1927, banking; 
and in 1928 and 1929 and also 1932, 
law, in which he is now engaged and 
which he considers is his final choice. The 
interest ratings of 1927 agree with his 
final decision. 

No. 226 reported in 1927, 1928, and 
1929 he did not know what he was going 
to do. In 1932 he was engaged in sell- 
ing steel products to farmers. His inter- 
est ratings are not very helpful, suggest- 
ing selling real estate and to a lesser de- 
gree purchasing and journalism. 

Some men have very broad interests so 
that they rate A or B in five to ten occu- 
pations belonging to two or more occu- 
pational groups. This seems to be fairly 
typical of the records secured from men 
of national reputation whether they are 


engaged in a profession or in business 
Others have fairly broad interests but 
largely or entirely restricted to one occu 
pational group. No. 205 in Table IV is 
typical. On the other hand, there are 
men who rate A or B in only one occu 
pation. Generally speaking these men 
are known as extreme specialists. 

The men who don’t know what the, 
are going to be while in high school or 
college fall into three groups. First 
there are those who rate high in two or 
more unrelated occupations as law and 
engineering, or accounting and the min 
istry. It is easy to see why they find it 
difficult to decide. Second, there are men 
who rate low in practically all occupa 
tions. No. 226 is a fair example of this 
type, although he is better off than some 
since he has a B+ and a B rating. Third, 
there are some whose ratings are similar 
to these who early make up their minds 
Why they don’t do likewise is a mystery. 

Ratings from the Vocational Interest 
Test should be viewed as suggestive and 
to be considered in the light of all other 
information bearing upon one’s voca 
tional choice. Occupations rated B 
B+, or A should be carefully considered 
before definitely deciding against them; 
occupations rated B— and C should be 
equally carefully considered before defi- 
nitely deciding to enter them. 


EDWARD K. STRONG, JR. (“The Voca- 
tional Interest Test”) is Professor of Psy- 
chology, Graduate School of Business, Stan- 
ford University. During the war, Dr. Strong 
was a member of the Committee on Classi- 
fication of Personnel for the Army. In addi- 
tion to a number of years spent on the staff 
of Columbia University, he has taught at the 
George Peabody College for Teachers and at 
Carnegie Institute of Technology. His 


publications include: Introductory Psy- 
chology for Teachers, Psychology of Selling 
Life Insurance, Job Analysis and the Cur 
riculum (with R. S. Uhrbrock), and Change 
of Interests with Age; and he devised the 
Strong Vocational Interest Test. He con- 
tributes many articles to psychological jour- 
nals on recognition memory, application of 
psychology to advertising, and vocational in- 
terests. 
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UNITY OR PURITY IN TRAITS 
AND TESTS 
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MONG some scientific students of 
A educational and vocational guid- 

ance there is now a strong de- 
mand for tests, records, ratings, or other 
instruments which will give measure- 
ments that are unitary or pure in the 
sense that whatever is measured by the 
test, rating, etc., is homogeneous, all of 
one piece, not a compound of two or 
more things which could as well, or bet- 
ter, be measured separately. It is desired 
that tests or ratings which are hybrids or 
compounds be so, not by our inadvert- 
ence, but by our intent in putting to- 
gether known units with known weights. 
It is the purpose of this article to state a 
few of the procedures and precautions 
which are desirable in the work of select- 
ing or constructing such tests. 

In the psychology of individual dif- 
ferences we have been accustomed to 
think in terms of abilities and traits or 
tendencies, such as the ability to read 
French, the ability to play the violin, the 
ability to tap rapidly, the trait of hon- 
esty with property, the trait of honesty in 
examinations, the trait of honesty in 
games, the trait of introversion, the trait 
of craving mastery or dominance, the ten- 
dency to suffer manic-depressive insanity, 
the tendency to hysteria, the tendency to 
like society, the tendency to bite one’s 
fingernails, and so on through a long list. 

Unless we know of some reason to the 
contrary, we tend to assume that the trait 
is unitary. But in strictness we should 
never assume this. In strictness this list 
should be broken up into an enormously 
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longer list in which the correlations 
would be perfect within any ability or 
trait. A statement that an individual pos 
sesses such and such an amount of an 
ability or trait or tendency is actually a 
statement that he has responded in cer- 
tain ways to certain situations or elements 
of situations and constitutes a proph 
ecy that he will do so in the future under 
similar conditions. Such a statement 
about one trait may thus be a general 
average or summary of particular abili 
ties, habits, wants, attitudes, interests. If 
these do not correlate perfectly they 
should not in strictness be attributed to a 
single unitary trait. 

In practice, however, if the intercor 
relations among a set of particular abili- 
ties, attitudes, etc., are very high, so that 
the community of causation very greatly 
outweighs the diversities, the latter may 
be neglected. In particular, diversities due 
to errors of measurement or to changes in 
conditions which are irrelevant to the 
qualities of persons should be neglected 

The prudent practice of averaging par- 
ticular abilities, attitudes, etc., in spite of 
known diversities, and treating the result 
as the measure of a unitary trait, should 
not confuse us into treating as the meas 
ure of a unitary trait an average or 
summafy score representing particular 
abilities, attitudes, etc., whose intercorre- 
lations we do not know. This is especially 
true if what we do know about them 
suggests that they are far from perfect 
Such average or summary scores are very 
valuable; they may be of notable service 
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in distinguishing individuals and in pre- 
dicting important facts. But they may 
not be measures of unitary traits; it may 
be misleading to call them by single 
names; it may be unwise to think of a 
person as having qualities corresponding 
to them. Some of the particulars within 
such an alleged trait, say musical ability, 
may correlate more highly with some of 
the particulars outside of it and inside of 
some other alleged trait than with some 
of those within it. The search for causes 
may be directed very differently, if the 
score is a summary or average of particu- 
lars with low intercorrelations, from the 
way chosen if the score is a measure of 
particulars with substantially perfect in- 
tercorrelations. For the former we must 
expect to find several causes; for the lat- 
ter we shall often hope to find one cause 
or factor, variations in whose amount ac- 
count for the variance among individuals. 


II 


An ability or trait that is unitary to 
ordinary observation may have a com- 
posite causation, and a very definite and 
unitary cause may, under different condi- 
tions (i.e, in cooperation with other 
causes), be hidden in many very diverse 
abilities or traits as observed and scored. 
Thus the ability in the running high 
jump—as measured by the total score in 
jumping over oak bars, pine bars, metal 
rods, wires, fences, and hurdles, indoors 
and out, morning, afternoon, and eve- 
ning, with clothes on and without, before 
spectators and alone, in competition and 
in practice—would probably show rather 
high intercorrelations in, say, a thousand 
male 25-year-olds chosen at random and 
practiced until each reached his limit. It 
would be a fairly unitary ability. But the 
causation of its unity might include the 
status of many muscles, various actions of 
the brain in timing and coordinating, and 


special physiological processes for releas. 
ing energy. On the other hand, the pres. 
ence of the micro-organism of syphilis is 
a highly unitary cause, with a rather sim- 
ple variation in influence according to the 
virulence of the specimens, which never. 
theless may under different conditions 
share in many traits of body and mind. 

An important case in mental measure- 
ment is where we use a score which we 
know or think is a total due to commu- 
nity plus diversity of a peculiar sort, 
namely, such that the elements or com- 
ponents producing the diversity are en- 
tirely independent or disparate or mu- 
tually exclusive in the sense that any one 
of them will correlate zero with any 
other. This case has been emphasized by 
Spearman in describing a common factor 
as a partial cause of the correlations be- 
tween scores in a number of rather 
“large” traits, the rest of the causation 
being contributed by specific factors no 
two of which have any community. We 
are here concerned with it in the case of 
rather “small” traits such as ability to add 
integers, or speed in running 100 yards, 
or fondness for sweet tastes, or ability to 
distinguish red from green. 

If the intercorrelations of various tests 
of a trait, say, the ability to add integers, 
can be explained by one common factor 
plus such specifics, and if the contribution 
of the common factor is very large com- 
pared with that of any of the specifics, it 
may be desirable to neglect the specifics, 
and consider the common factor alone.’ 
The total score of a considerable number 
of such tests will be a measure of the 


1 The subject is, of course, restricted to the 
work with the trait in question. It is highly un- 
desirable to neglect them in toto. Being born of 
rich parents may be a trivial specific in respect to 
the addition of integers, but an important group 
factor in the case of twenty tests of knowledge of 
social customs and ability at games, and perhaps 
an important common factor in a dozen tests of 
prejudice in favor of capitalism. 
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UNITY OR PURITY IN TRAITS AND TESTS 


common factor alone, to a very close ap- 
proximation. The mere existence of a 
common factor is not a sufficient justifica- 
tion. If it contributes little, accounts for 
little of the variance, some of the spe- 
cifics may be more important than it for 
analysis, prediction, causation, or other 
purposes. For historical reasons discus- 
sions of such specific factors have been 
concerned chiefly with their presence. But 
in the actual work of mapping the mind, 
their magnitude in comparison with the 
common factor is of great importance. 

Unless one is familiar with recent 
work in mental measurements one is 
likely to overestimate the contributions 
from common factors in comparison with 
those from specific, group, or overlap- 
ping factors. The expert psychology of 
the past and the popular psychology of 
the present use freely words like atten- 
tion, memory, imagination, judgment, 
reasoning, musical ability, artistic ability, 
mathematical ability, honesty, patience, 
courage, and leadership. The use of such 
words tempts us to think that there are 
unitary cores or strands or features of be- 
havior corresponding to the word, and 
that these account for the great bulk of 
the variance among individuals. On the 
contrary, the expectation from actual 
measurements is that the web of life is 
not constructed from a score or so of 
large unitary stripes in warp and woof 
plus some thousands of very minor 
threads, and adventitious tags and frag- 
ments. The safe procedure is not to as- 
sume what the total score of a group of 
tests or items measures but to observe 
their intercorrelations. 


Ill 


The work of selecting or constructing 
tests which will be “unitary” or “pure” 
in our sense is beset with other difficul- 
ties which cannot be described here. Nei- 
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ther is there space to estimate the prob- 
able benefits, assuming that enough is 
known to justify such an estimate. It 
may turn out that present methods of 
using what seem promising groups of 
symptoms of some important fraction of 
man, determining the validity of the re- 
sulting scores for various descriptions and 
prophecies, using them in regression 
equations, and analyzing them ex post 
facto by the analyses of Spearman, Kel- 
ley, Thurstone, Hotelling and others may 
continue to be the most profitable line of 
attack. One of the “factors’’ or “com- 
ponents” located by these analyses has the 
great merit of correlating zero with all 
other factors of the analyzed variance. 
This independence may be a more valu- 
able asset than the purity we have been 
discussing. Moreover, traits which cor- 
relate zero with others are likely often to 
be pure, so that it may be wise to con- 
struct any pure test by selection from 
elements which a factor-analysis suggests 
are due entirely to one independent fac- 
tor or component. On the other hand, it 
may be argued that pure tests are likely 
often to be due to independent factors or 
components, and that if we can use them 
from the beginning, the regression equa- 
tions may be simpler and the analyses 
into factors may be more illuminating 
eZ 
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HAT practical contribution can 
W cries testing make to voca- 

tional guidance? Before this 
question is discussed, a distinction should 
be made between two terms which are 
often confounded—"‘ability’’ and “‘apti- 
tude.” “Ability” should be used to 
designate a specific skill which has been 
acquired through training or experience, 
for example, skill in taking shorthand. 
“Aptitude’”” should be used to designate 
the readiness with which an untrained 
person acquires a given skill. Thus the 
Gregg Stenographic Speed Test would be 
classed as an ability test, since it was de- 
vised to measure the degree of skill pos- 
sessed by stenographers, while a test de- 
signed to select persons who might 
profitably take a course in stenography 
would be classed as an aptitude test.’ It 
is tests of the latter sort that we shall dis- 
cuss in this paper. 

No one knows the origin of vocational 
aptitudes. One view seems to be that 
they are born within the individual. Thus 
we hear that this or that person is a 
“born” inventor, actor, salesman, or 
aviator; that ‘poets are born, not made”’; 
that a book was recently entitled, Born 
That Way. From all that is known about 
the hereditary nature of man, scientists 
are not inclined to admit the existence of 
ready-made vocational aptitudes. The 
evidence seems rather to support the view 
that environmental factors play a large 


1 Employment Psychology, Burtt, H. E. Boston, 
Houghton Mifflin, 1926. Pp. 62. 


part in conditioning an individual toward 
successful adjustment in certain occupa- 
tions. In view of this fact, most psy- 
chologists regard aptitudes as existing 
phenomena regardless of their origin, and 
try to devise tests for them. The mat 
ter really deserves more attention than is 
here allotted to it, for on one’s theory 
regarding aptitude hinge important ques- 
tions—the legitimacy of prediction as a 
technique of vocational guidance and se- 
lection, the possibilities of training, the 
influence of motivation, etc. Due to 
exigencies of space, however, we must 
omit further discussion and proceed to 
the practical question posed at the be- 
ginning of this article. 

The vocational counselor who wishes 
to use the most up-to-date techniques is 
confused by the large number of tests 
which purport to measure various apti- 
tudes. They cover a wide range of oc- 
cupations, from power-machine operator 
to that of technical engineer. Even for 
the same occupation, as many as three or 
four different tests have been invented by 
different persons, and the perplexed 
counselor asks, ‘““Which one shall I use? 
Indeed, are any of them suitable for 
practical use?’’” In this paper we shall 
present the considerations that must be 
taken into account in judging the value of 
an aptitude test. 


II 


Necessity for testing a test. It is easy 
enough to invent a test and label it “A 
Test for Salesmen,’’ but before it is ap- 
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plied in a practical situation it should be 
proven to be a test for salesmen. The 
technique for establishing this proof is 
highly complicated and exacting. The 
test must be given to a group of persons 
in the occupation (preferably 100 or 
more), whose proficiency is known so 
well that they can be reliably arranged in 
order from highest to lowest, or at any 
rate, grouped in several grades such as 
Superior, Good, Average, Fair, Poor. 
The scores made on the test should, if the 
test is valid, rank the individuals in the 
same way as they were ranked according 
to their occupational proficiency. 

There is one objection to this plan of 
testing persons who are already proficient 
in the occupation. By reason of their 
training and experience they have be- 
come non-representative of the type of 
persons for whom the test has been de- 
vised—namely, persons who have had no 
experience in the occupation. In order 
to overcome this objection another plan 
has been used by some investigators: that 
of testing applicants for work and hiring 
them regardless of the scores they made 
on the test; then observing the readiness 
with which they acquire the necessary 
skill and the degree of proficiency which 
they eventually develop. One of the in- 
frequent examples of this procedure was 
furnished by Johnson O’Connor at the 
Lynn Plant of the General Electric Com- 
pany.” 

Difficulty of measuring occupational 
proficiency. One of the first obstacles en- 
countered in following either of these 
procedures is that of determining units 
with which to denote the degrees of skill 
of the workers tested. In the case of 
salesmen, for instance, it is not fair to 
use number of sales, nor gross amount of 


2 Johnson O'Connor, Born That Way. Balti- 
more, Williams and Wilkins, 1928. 
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sales, nor amount of commission. Bing- 
ham and Freyd list 13 different types of 
criteria which may be employed, but it is 
admitted that no single one is fair and 
there is no known way of combining sev- 
eral into a satisfactory measure.’ Failing 
in finding desirable objective criteria, 
most investigators have contented them- 
selves with using ratings supplied by 
foremen or supervisors. These are, how- 
ever, notoriously unfair, being colored by 
prejudice, whim, and insufficiency of ac- 
quaintance. The impossibility of obtain- 
ing an equitable basis for establishing de- 
grees of proficiency would be enough to 
cast adoubt on aptitude tests all apart 
from other limitations which will pres- 
ently be discussed. 

A perplexing circumstance is that even 
after a test is standardized it can legiti- 
mately be used only with the type of per- 
sons to whom it was originally given 
Thus a test which was standardized in 
terms of a group of automobile salesmen 
in New York City could not properly be 
used in selecting or guiding salesmen of 
footwear or even automobile salesmen in 
Dallas. 

Establishing validity. But to proceed 
with the steps which must be taken in 
proving that a test is valid: After the 
subjects are ranked as well as possible ac- 
cording to vocational proficiency and ac- 
cording to the scores made on the test, it 
is necessary to relate these rankings to 
each other. There are various ways of 
doing this. One is to establish a critical 
score. For example, in the following 
table, an employment manager might 
have determined that he would not ac- 


3W. V. Bingham and M. Freyd, Procedures 
in Employment Psychology. New York, McGraw- 
Hill, 1926. Chap. II. See also R. M. Elliott, L. D. 
Anderson, H. A. Toops, and E. Heidbreder, 
Minnesota Mechanical Ability Tests, Minneapolis, 
University of Minnesota Press, 1930. Chapter IX. 
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TABLE I 
SAMPLE ARRANGEMENT OF 50 WORKERS ACCORDING TO OCCUPATIONAL 
PROFICIENCY AND SCORES ON TEST 
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cept any one for a certain job who could 
not produce at least 92 units of work. 

By inspecting column 2 we see that to 
find such persons he would have to set a 
critical score on the test above 84, since 
that is the lowest score made by any one 
(Individual G) in the “‘satisfactory” 
group. In using this score the employer 
would be hiring two persons (Individuals 
N and R) who would not reach the re- 
quired output of 92 units, but in all other 
cases the test would constitute a good se- 
lective instrument. 

This technique, which can be applied 
at the lower end as well as the upper end 
of the scale, lends itself particularly well 


to vocational selection—that is, the selec- 
tion of employes in a busincss establish- 
ment—or to the admission of students in 
an educational institution. 

Another technique, which has been 
more widely used in determining the 
validity of an aptitude test, seeks to de- 
termine the relationship between pro- 
ficiency and test-score in terms of an 
index of correlation. If this is .75 or 
above the test is generally considered to 
be useful. But few of the aptitude tests 
on the market meet this requirement 

Reliability. Another factor which 
should be determined regarding any pro- 
posed aptitude test is its reliability. By 
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this is meant the consistency with which 
the test operates. Two methods are com- 
monly used for determining this. One is 
to use alternate items of the test and 
determine if the individuals taking the 
test stand in relatively the same positions 
on both sets of items. Another is to give 
the test twice and see if the standings are 
the same both times. The latter method 
is not advisable, since the experience of 
taking the test once is likely to affect 
performance on it a second time. Indeed, 
strictly speaking, the second test becomes 
a different test from the first, for the 
“mental set” of the subject becomes dif- 
ferent. James stated this phenomenon as 
follows: ‘No state once gone can recur 
and be identical with what it was before. 
... Every thought we have.. . is, 
strictly speaking, unique. . . . When the 
identical fact recurs we must think of it 
in a fresh manner . . . apprehending it 
in different relations from those in which 
it last appeared.”’* 

Regardless of the way in which the re- 
liability is determined a correlation should 
be computed showing the reliability. This 
should be around .95. When we ex- 
amine the indices of reliability reported 
in connection with aptitude tests we find 
that few of them approach the desired 
figure. Indeed, many investigators have 
not even taken the trouble to compute the 
reliability. 

With every index of correlation should 
go a measure of the dispersion, usually 
expressed in terms of probable error or 
sigma. Many inventors of tests fail to 
give such a figure. The figure, whatever 
it is, is a function of the number of sub- 
jects to whom the test was originally 
given. As was said in a preceding para- 
graph, the number of subjects should be 


* William James, Psychology, Briefer Course. 
New York, Henry Holt, 1893, p. 154. 
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at least 100, but many inventors of apti- 
tude tests have used much smaller groups. 


Ill 

Is prediction possible? In the litera- 
ture on aptitude testing the point is often 
made of the desirability of predicting 
the vocational success of an individual.* 
With respect to this point it should be 
noted that prediction from massed sta- 
tistics can not be made in terms of an in- 
dividual. At best the individual could 
only be said to possess the aptitude nec- 
essary for success in a given occupation. 
Whether or not he would use that apti- 
tude in future years could never be pre- 
dicted. In vocational guidance, at least, 
aptitude tests can not tell fortunes. 
“Another observation we should make 
is that aptitude testing is more useful in 
vocational selection than in vocational 
guidance. In the former case we wish to 
select, from a number of applicants, the 
one who is likely to do the best work on 
a particular job. In this undertaking, 
aptitude tests, even some of the faulty 
ones now on the market, have been rea- 
sonably useful. But in vocational guid- 
ance, that is, in trying to help an individ- 
ual to choose a vocation, aptitude tests, 
even perfect ones, will probably not be of 
much practical value, for even though an 
individual might have the aptitude dis- 
covered by the test, he would probably 
have a number of others. So variable are 
human capacities that it is probable that 
50 per cent of the population could suc- 
ceed, with a 50 per cent degree of suc- 
cess, in 50 per cent of the occupations. It 
would surely be impracticable to try to 
test every individual for all of the several 
thousand occupations. 
Indeed, one might well question 
whether the concept of “vocational apti- 


SC. L. Hull, Aptitude Testing. New York, 
World Book Co., 1928. Chap. XIV. 
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tude” is legitimate. Surely if by it we 
mean a psychological entity, we should 
seriously doubt its very existence.* 
Under any circumstances, the evidence 
strongly favors the view that a vocational 
aptitude, if it exists at all, is not a unitary 
trait but rather a collection of traits. Thus 
Seashore conceives of musical talent not 
as a unit, but as a group of traits such as 
sensitivity to pitch, sensitivity to rhythm, 
etc. The authors of Minnesota Mechan- 
ical Ability Tests, already referred to, 
found no evidence to support the view of 
mechanical aptitude as a general factor, 
they rather upheld the idea that it is 
made up of a number of specific factors. 

In spite of the severe strictures here 


*H. D. Kitson, “Does General Mechanical 
Aptitude Exist?”, Industrial Arts and Vocational 
Education, June, 1930. Pp. 215-219 


recounted, it is probable that psychol- 
ogists will continue to devise aptitude 
tests and that an eager and gullible pub- 
lic will continue to use them. Two warn 
ings should, at any rate, be heeded 
First, all experimentation should be left 
to well-trained psychologists. The tech 
nical difficulties involved are so great 
that no one else can be expected to steer a 
safe course. Second, it is generally recom 
mended that instead of spending their 
time devising new tests, pyschologists had 
better test the tests already available and 
determine their vocational significance. If 
this advice is heeded, the years to come 
may see less emphasis placed on the 
efficacy of psychological tests, and more 
attention paid to other techniques which 
are likely to yield better results in prac 
tical vocational guidance. 
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HARRY DEXTER KITSON (‘Aptitude Test- 
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WANTED: 


professional guidance worker to more pop 
ular treatments of the subject for use by the 
individual seeker for guidance. Dr. Kitson’s 
work in this country and abroad has made 
him familiar with activities in vocational 
guidance and industrial psychology around 
the world. He has served as President of 
the NVGA and is an active member of many 
educational societies. 
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A TITLE 


The NOC bibliography of occupational information, prepared by Wil- 
lard E. Parker and described in the October issue of this magazine, will 
shortly be published for NOC by the American Library Association. This 
bibliography comprises about 9,000 titles relating to more than 500 


occupations. 


Who can suggest an appropriate and effective title for the book? Write 
to National Occupational Conference, 522 Fifth Avenue, New York City. 
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APTITUDE TEST BATTERIES 


Procedures in Their Construction 


CLARK L. HULL 

















Or 


every person has a certain amount 

of potential aptitude for the per- 
formance of every possible vocation. 
Probably in no two aptitudes, however, 
does a given person have equal poten- 
tialities. There is convincing reason to 
believe that the distribution of abilities 
of any person for the performance of the 
various possible vocations distributes it- 
self very much according to the “normal 
law”; that is to say, the most of each 
person’s potential abilities probably group 
themselves rather closely around some 
central tendency, but a good many of 
them scatter off in decreasing numbers in 
each direction, a few of them represent- 
ing very low abilities and a few, very 
superior abilities. It is one of the func- 
tions of a scientific vocational guidance to 
ascertain in which aptitude of each per- 
son these relatively superior abilities lie, 
to the end that he may choose these for 
his life work rather than vocations which 
lie at the opposite extreme of his abili- 
ties. It is the function of aptitude tests 
to aid the vocational counselor in the dis- 
covery of these latent maximal po- 
tentialities. 


ee for very unusual individuals, 


II 

Psychological tests are of many kinds. 
For the most part they are samples of be- 
havior which have been found to be re- 
lated in some way to abilities to perform 
the work of socially valuable occupations. 
The most certain way to determine 
whether a person has a given vocational 
aptitude is to put him in the vocation and 
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try him out. Unfortunately this mode of 
procedure often takes the good share of a 
lifetime, so that as a means of vocational 
guidance it is valueless. The use of psy- 
chological tests at the present time lies 
not so much in their high precision of 
predictive value as in the fact that con- 
sidering what predictive value they have 
the cost of time and effort is relatively 
slight. Most aptitude tests in current use 
may be administered in two or three 
hours. 

Experience has shown that vocational 
aptitudes are usually very complex. Suc- 
cess in them depends upon so many dif 
ferent abilities that single psychological 
tests are almost never adequate to yield a 
useful prognosis. As a result, it has been 
found necessary in practically all cases to 
combine a number of tests for this pur 
pose. Such a combination of tests is 
called an aptitude test battery. The con- 
struction of useful aptitude test batteries 
is a task requiring considerable labor and 
technical skill, and is usually not a job 
for an amateur. It is desirable, however, 
for vocational counselors and others who 
would use aptitude tests intelligently to 
know something of how they are con- 
structed, and how their actual utility is 
determined. 

The procedure of doing this may be 
briefly summarized under seven headings 
or steps, which are as follow: — 

(1) The psychological analysis of the 
vocation. 

(2) The choice of a preliminary bat- 
tery of tests. 
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(3) The administration of the pre- 
liminary battery to a group of individuals 
whose actual abilities on the aptitude in 
question may be measured. 

(4) The determination of the actual 
aptitude of the individuals in the trial 
group. 

(5) The comparison of the test scores 
with the actual abilities of the subjects on 
the aptitude and the rejection of all tests 
thus found to be useless. 

(6) The combination of the tests 
found to be valuable into a battery which 
will yield a prognosis of the aptitude on 
individuals whose aptitude is not other- 
wise known. 

(7) The administration of the apti- 
tude battery thus constructed to a second 
group of subjects whose ability in the 
aptitude can be measured, to the end that 
a determination may be made of exactly 
how accurately the test battery as a whole 
is able to predict this aptitude. 


Ill 


The first step in the construction of 
aptitude test batteries is the analysis of 
occupational behavior. One of the best 
preliminary steps is for the investigator 
actually to work at the task for a few 
days or weeks. On a simple level this 
analysis consists merely of an attentive 
observation of a person engaged in the 
vocation; this should result in an explicit 
statement of all the part-activities which 
the worker actually performs. This is 
known as the job analysis. If time per- 
mits, this analysis should be continued by 
determining in which of the part-activi- 
ties of the job the persons recognized as 
superior excel those who are recognized 
as being inferior, and in which there is 
little or no difference; the latter are dis- 
carded from further consideration. The 
third part of the process is an attempt to 
discover for the former part-activities 
what traits of intelligence, capacity, tem- 


perament, will, etc., combine to produce 
efficiency in them. 

The second step in the construction of 
an aptitude test battery,—the assembling 
of a trial battery of tests,—requires for its 
effective conduct a very wide knowledge 
of psychological tests. During the last 
twenty years an enormous number and 
variety of tests have been devised and re. 
ported. Many of these may now be pur. 
chased from various publishing houses 
and apparatus companies. The more 
common forms of psychological tests are 
those made up mainly of verbal material, 
such as the familiar Binet tests, Arm, 
Alpha, etc. Many of the pencil-and- 
paper tests are especially economical in 
use because a large number of people 
may be given such tests simultaneously 
by a single trained experimenter. Ap- 
paratus tests are often very useful also 
particularly those which duplicate the 
more important part-activities of the vo- 
cation in miniature, though they suffer 
from being expensive both to purchase 
and to administer. The well-known 
Stenquist mechanical assembling test is an 
example of such a test. 

The third step in the process of apti- 
tude test construction is the administra- 
tion of the preliminary test battery to a 
trial group of subjects. Ideally there 
should be at least fifty or sixty of these 
individuals. They should be persons, if 
possible, who have not yet been trained 
in the vocation, but who will be so 
trained subsequently and under condi- 
tions such that the actual success of the 
training can be determined with some 
precision. In the giving of these tests it 
is of the utmost importance that active 
cooperation should be secured from the 
persons tested. If this cannot be obtained 
the experiment might about as well be 
abandoned. 

The fourth step is the determination 
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APTITUDE TEST BATTERIES 


of the actual aptitudes of the trial sub- 
jects. Ideally, after the tests have been 
given, the subjects go through their train- 
ing for the aptitude in question. For 
many important aptitudes often as much 
as a year of intensive training should fol- 
low the testing, and for some, such as the 
professions, this may extend to a number 
of years. At the end of the training 
period some measure must be found of 
the proficiency to which each individual 
has attained. This step of the process is 
by all odds the most difficult of the seven. 
The reason is that for the most part we 
have no adequate scales with which to 
measure such abilities. For example, in 
what units shall we measure the differ- 
ence between the artistic value of a child's 
drawing in comparison with one of the 
incomparable cartoons of Leonardo da 
Vinci? In what units shall we determine 
the extent of the difference between the 
violin music produced by an ordinary jazz 
musician and that by Fritz Kreisler? At 
first sight it would seem quite impossible 
to give a quantitative determination of 
such differences, even though everyone is 
keenly aware that they exist in large 
amounts. The situation, while difficult, 
is not by any means hopeless. During 
recent years, experimentalists and_ sta- 
tisticians in collaboration have devised 
adroit means whereby quite astonishingly 
effective quantitative determinations can 
be made of such intangible variables. 
Among the basic devices employed for 
this purpose are those of having the sub- 
ject’s performance ranked by experienced 
judges and the use of various forms of 
rating scale. 
IV 

The fifth step in the development of 
an aptitude test battery is the selection of 
the final aptitude battery from the group 
of tests administered to the trial group of 
subjects. As a rule no more than one- 
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half or one-third of the tests which seem 
promising for an aptitude turn out really 
to be so. For this reason a dozen or 
fifteen tests should usually be employed 
in the preliminary trial if as many as five 
really useful tests are desired for the final 
battery. The basis for deciding whether 
a given test will be retained in the final 
battery is whether or not in combination 
with other tests it will contribute mate- 
rially to the accuracy of estimating a sub- 
ject’s aptitude. The main consideration 
in this connection, but by no means the 
only one, is whether the scores on the test 
correlate strongly with the scores on the 
aptitude. The means of determining the 
extent of such agreements is a statistical 
procedure known as correlation. In gen- 
eral, tests which correlate very little with 
the aptitude are bad tests and are sum- 
marily rejected. But the mere fact of 
correlating well with the criterion does 
not make a test valuable in a battery; if 
two tests correlate very highly with each 
other this means that both test the same 
function, and since it is a waste of time 
to test a given function more than once, 
one of two such tests would also be re- 
jected. 

The sixth step in the construction of an 
aptitude test battery consists in devising 
a method whereby the scores from the 
several tests of the battery may be com- 
bined in such a way as to predict the apti- 
tude score with the greatest possible de- 
gree of accuracy. There are numerous 
ways of doing this, some very simple and 
some fairly complicated. Many aptitude 
tests require mere adding up of the gross 
scores. This, however, is not a very ade- 
quate method. The reason is that often 
one test will be of very much greater 
significance for the vocation than another 
test, and should therefore receive corre- 
spondingly greater weight in the final 
prognosis or prediction. Unfortunately, 
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the assignment of weights in a complex 
battery of tests is not a matter which can 
be achieved by mere inspection of the ex- 
perimental results. The most effective 
means for determining these weights, and 
in general of deriving an adequate fore- 
casting formula for a battery of aptitude 
tests, is the multiple regression technique. 
This is somewhat complicated, but the 
outcome is fairly simple. It yields a 
simple formula, the values of which are 
to be multiplied by the respective test 
scores of any given individual; when the 
products are added up, there results a 
pfediction in terms of the ordinary score 
on the aptitude. 

The seventh and final stage of the 
preparation of a battery of aptitude tests 
consists in applying the tests to an en- 
tirely new group of individuals who are 
constituted substantially like those of the 
trial group. Exactly as in the case with 
the trial group, the tests should be ad- 
ministered to the subjects before they 
have had the training for the aptitude. 
When the aptitude training is completed, 
a careful determination must be made of 
the actual attainments of each individual, 
after which the aptitude predictions based 
on the test scores are compared (corre- 
lated) with the actual aptitudes of the 
subjects. This procedure is known as 
validation. If a battery yields a correla- 
tion of .50 or better, and does not re- 
quire too long to administer, it may be 
said to have some significance as a voca- 
tional guidance instrument. Some of the 
better aptitude tests, particularly those of 
scholastic aptitude, are said to have 
reached correlations as high as .70 and 
even higher. Such tests may be con- 
sidered to have considerable value. In 
general, tests which are advertised for 
sale for purposes of aptitude prognosis, 
but which have not been validated in 
some such manner as here described, 


should not be purchased unless definitely 
for the purpose of research. If the pur 
chasing public would go on a buyer 
strike and steadfastly refuse to purchase 
aptitude tests until they have been vali- 
dated and the validity coefficients clear\, 
stated, it would have a wholesome effect 
on the construction of aptitude tests, and 
the purchasing public would save con 
siderable sums of money. 


V 


What are the future developments in 
this field likely to be? This may best be 
appreciated by contrasting it with what 
should logically take place at present if 
adequate tests existed. The problem of 
vocational guidance is to be able to tell 
each youth seeking a life work which of 
the many occupations in the world he is 
best endowed to pursue. It is likely that 
there are as many as fifty important type 
occupations available to many young per- 
sons. If adequate tests existed for fore- 
casting aptitude in each of these voca- 
tions, the only way to determine the apti- 
tude of maximal potentiality for a given 
youth would be to administer all fifty 
test batteries to him. This alone might 
require a month of a youth’s time, to say 
nothing of the time of an expert ex- 
aminer. Such a procedure would be quite 
unnecessarily wasteful, because the differ- 
ent test batteries would certainly involve 
an immense number of duplicated tests 
The cure for this tremendous waste, as 
well as numerous other defects of the 
present procedures, would be to adminis 
ter a single large battery of tests which 
would give a judicious sampling of the 
entire spectrum of human abilities but 
without duplication. Such an aggrega 
tion of tests might appropriately be called 
a universal aptitude battery. Once the re 
sults from such a battery were available, 
the scores of those tests which combine 
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APTITUDE TEST BATTERIES 


to make the best aptitude forecast for 
each particular vocation could be com- 
bined, and the aptitude forecast made 
separately for each of the numerous vo- 
cations one after another. 

For several years there has been in 
existence a machine which, when given 
the test scores and the forecasting 
formulas in the form of perforated paper 
tapes, is able to make aptitude forecasts 
automatically. With a little modification 
this machine could be made to record in 
a column on a card, like an adding ma- 
chine, the aptitudes thus calculated, each 
opposite the name of the vocation in 
question. The card of forecasts, when 
removed from the machine, would then 
present in orderly array, in units of a 
single uniform scale permitting of instant 
comparison, forecasts of the individual's 
probable success in all the chief type oc- 
cupations. The vocational adviser could 
then examine the card to learn those vo- 
cations in which the youth’s chance of 
success is least. ‘These would be sum- 
marily discarded. The counselor could 
then examine the card to learn those vo- 
cations in which, other things being 
equal, the chance of success is most likely. 
The three or four most promising voca- 
tions thus emerging might then be given 
special consideration, and from these, in 
the light of the youth’s interest, oppor- 


tunities, and general circumstances, an in- 
telligent choice of a life work might be 
made. 

What would not vocational counselors 
give if such information were really 
available! Many signs indicate the prob- 
ability that before many years something 
approaching this ideal will actually be 
realized. Technical experts in this field 
are rapidly reaching a point in the knowl- 
edge of human nature on one hand, and 
of experimental and statistical methods 
on the other, such that a direct frontal at- 
tack on this immense problem may be ex- 
pected to be feasible. The task of bring- 
ing it about, however, will be a tremen- 
dous one. 
possible attainment of any one individ- 
ual. On the other hand, it requires such 
a close integration of effort on the part 
of many workers that it must be carried 
out under some single central direction 
This means that in all probability the 
plan will be realized only through sub- 
stantial subsidy either from the govern- 
ment or some of the research founda- 
tions. Meanwhile the date of its ac- 
complishment will be materially hastened 
by an insistent demand on the part of 
vocational counselors and those vitally in- 
terested in the vocational guidance 
movement. 


It is clearly quite beyond the 
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THE PSYCHOLOGICAL EXAMINATION 


Its Place in Vocational Guidance 
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HE SCIENCE of Applied Psychol- 

I ogy can give to the vocational 

counselor aid which is of great in- 
terest and importance at the present time. 
From the broadest point of view, any 
study of the behavior of a human being 
which leads to a better knowledge of his 
interests, his temperament, his intellectual 
capacity, or his special aptitudes’ is a piece 
of practical psychology, even though the 
terms in which it is expressed may resem- 
ble very little the technical phraseology 
of the professional psychologist. Whence 
it is a reasonable conclusion that, insofar 
as such a study enables an adviser to sug- 
gest a material environment or a spiritual 
atmosphere most appropriate for the in- 
dividual’s further development (vocation- 
ally, educationally, or socially) it cannot 
fail to contribute to a better solution of 
that individual’s problem. 

The real point at issue is not whether 
this study shall be a psychological one— 
it cannot possibly escape being that—but 
whether it shall be a systematic or a hap- 
hazard one, and what form or forms it 
shall take. Unless the observations 
which constitute part of the psychological 
study of an individual are reliable (i.e., 
sufficiently near to the truth to warrant 
belief in them), and appropriate ((i.e., 
concerned with those elements in the in- 
dividual’s mental and physical make-up 
which actively influence his methods and 
power of adapting himself to his varied 





1 This order is not necessarily an order of pref- 
erence or importance. 


environment), they can contribute little 
to that fullef understanding upon which 
all sound advising must ultimately de- 
pend. The mere amassing of informa- 
tion can have no value in itself; more- 
over, too much detail may be as embar. 
rassing as too little. The relevant must 
be skilfully selected from the irrelevant 
and this requires a full and accurate 
knowledge of the methods and results of 
scientific investigation in this special 
field. 

In this sense, as well as in regard to 
the actual steps of procedure, any psy- 
chological study must be systematic; for 
it is evident that collections of casual ob- 
servations or of prejudiced opinions can 
seldom provide satisfactory data for 
sound advising. In vocational guidance 
in particular the use of scientific methods 
means a careful attempt to evaluate just 
those abilities and character qualities of 
the individual which will have a bearing 
upon his vocational success. In the course 
of such studies information bearing upon 
other phases of his active life may be 
obtained, but these are relevant to our 
problem only to the extent that they in- 
volve vocational issues. Obviously some 
of them, such as the educational and the 
social, are so closely linked with the vo- 
cational adjustment of the individual that 
they cannot be isolated from it. This, 
however, only means that the vocational 
adviser must not too narrowly restrict the 
scope of his investigations; and, although 
the kind of data he collects may thus be- 
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THE PSYCHOLOGICAL EXAMINATION 


come widely varied, the method of its 
collection and interpretation must remain 
as constant as possible. 


II 


The idea of studying the individual in 
a scientific way is not exactly new; yet, 
by reasonably exact standards, achieve- 
ments up to the present have not been: 
very impressive. This is partly due, I 
think, to our failure to realize sufficiently 
the great complexity of the problems of 
vocational guidance. In seeking a non- 
existent “short cut” we have often been 
tempted to depend too much upon infor- 
mation derived from a restricted field of 
inquiry, neglecting other perhaps equally 
valuable sources. Those examination de- 
vices called “psychological tests,’’ which 
are now so popular, have gained a place 
of importance because it was hoped that 
their use would render superfluous other 
more laborious or less reliable methods 
of investigation. But we cannot honestly 
say that this is yet the case. Valuable 
though these tests undoubtedly are, they 
have not yet reached such a pitch of valid- 
ity and reliability as to supplant other 
sources of information. 

Even if they can be developed to such 
a degree of usefulness, it remains doubt- 
ful whether vocational guidance should 
become the “rule-of-thumb’’ procedure 
which their sole use would imply. There 
have been proposals for the construction 
of forecasting machines, uncanny inven- 
tions into which are to be fed the indi- 
vidual’s scores in a “battery” of tests, and 
from which will emerge a typed slip 
showing the special aptitudes of the indi- 
vidual disclosed by the tests. Personally 
I think that such a device—labor-saving 
though it be—is not likely to achieve our 
main purpose, for if there is one essential 
element in any advising procedure, it is» 
the personal contact between the coun- 
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selor and the counseled. Remove the 
“psychology” from the “psychological 
test’’ and what have you left? 

Many tests are said to be “fool-proof” 
in their application, but I know of none 
which are ‘‘fool-proof’’ in their interpre- 
tation, because the psychological situation 
to which the individual has responded 
during the test has been partly cre- 
ated by himself, has been affected by 
his “‘personality,”” and has therefore be- 
come different from the in 
which previously tested individuals found 
themselves. True, there are many com- 
mon elements in all these situations; and, 
in general, the common elements no 
doubt predominate,—for only so can a 
test have any diagnostic value. But the 
possibility of error in the result must be 
ever present in the mind of the observer, 
and he must use considerable skill and 
experience in summarizing his observa 
tions into a true expression of the indi- 
vidual he has observed. 

For this reason vocational guidance 
should be based upon “psychological 
examinations” rather than tests, though 
the latter have their place. The inter- 
view, the temperament-rating, the ques- 
tionaire (to be filled in by the person to 
be advised), and the like, are all devices 
which may contribute usefully to the final 
result, and so may form part of the com- 
plete psychological examination of the in- 
dividual. But these devices express only 
the form and content, the apparatus and 
the method, of the inquiry; the interpreta- 
tion of the results still remains, and it 
will be apparent that the keener the 
psychological analysis and the more 
numerous the aspects of the behavior of 
the individual it has embraced, the better 
is this interpretation likely to be. 

Vocational advisers may be whole- 
heartedly in agreement with this prin- 
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ciple, but may be compelled through lack 
of time to apply it very little in their 
practical work. Hence the question of 
the adequacy of a psychological examina- 
tion is of considerable practical impor- 
tance. What is the most effective type of 
examination? When and where should 
it be given? 

As yet only provisional answers may be 
made to questions such as these. As we 
learn more of the relations between the 
aptitudes and the achievements of in- 
dividuals, between measures of abilities 
and occupational success, between quali- 
ties of temperament and character and 
achievement, we shall slowly but surely 
improve our vocational advising. The 
counsel we are able to give now is cer- 
tainly better than it was five or ten years 
ago, and we may reasonably hope for 
progressive improvement as our tech- 
nique of examination is perfected. 


Ill 


Recent vocational guidance research in 
Great Britain has strengthened this be- 
lief in the value of a sound psychological 
study of each individual. But the meth- 
ods of necessity adopted in an investiga- 
tion of limited duration may not prove to 
be those most suitable for practical day- 
to-day advising. In the London Experi- 
ment carried out by the National Insti- 
tute of Industrial Psychology, the com- 
plete psychological examination was 
given within a few days (or weeks at 
most), so that the results represented a 
sort of ‘cross section’ of the individual 
taken prior to his fourteenth birthday. 
The diagnostic value of these measures 
depended, not only upon the extent to 
which they truly represented the psy- 
chological make-up of the individual, but 
also upon the extent to which this make- 
up remains characteristic of him during 
his occupational life. Apart altogether 


from the validity and reliability of the 
methods of examination employed, there 
were therefore two important sources of 
error: the first was the possibility that the 
individual's variations in performance 
were so great that no “‘picture” of him 
of any value for diagnostic purposes 
could be obtained; the second, the pos 
sibility that even if the “‘picture’’ ob- 
tained at the age of 14 were a true one 
it might bear little resemblance to that 
which expresses the individual at the age 
of 16, 18, or 20. 

In the London Experiment follow-up 
studies of the industrial history of the 
boys and girls examined extended over 
four years. Not a very long time per- 
haps, but long enough to give useful 
data.* In spite of the great complexity 
of the investigation and the many conflict- 
ing issues involved, it was shown quite 
convincingly that there is a definite associ- 
ation between psychological make-up and 
vocational success, both in the experi- 
mental group and in the control group 
This latter group consisted of boys and 
girls of the same age (14) leaving from 
the same schools at the same dates. But 
whereas in the control group the individ- 
ual’s make-up had to be guessed from 
his school marks and from teachers’ re- 
ports, in the experimental group it was 
based upon a comprehensive psycholog- 
ical examination in which marks and re- 
ports played a minor part. The superi- 
ority of the advising of the experimental 
group was clearly demonstrated.* 

In a similar experiment in Birmingham 
a year or two later the same general pro- 
cedure was followed, and even more 


2 Incidentally, only those who have tried to 
follow up continuously over a period of years one 
thousand or so “strangers” (who have no personal 
interest in the inquiry) can appreciate the labor 
involved. 

8 Methods of Choosing a Career, F. M. Earle 
and others. London, Harrap and Company, 1931 
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THE PSYCHOLOGICAL EXAMINATION 


striking evidence of its value was ob- 
tained. No reasonable person can now 
be in doubt—if he ever was—that abili- 
ties and character qualities shown by an 
individual in his youth have a powerful 
influence on his later success, and that 
these can be measured with sufficient ac- 
curacy for predictive purposes. Where 
constructive criticism should now be ap- 
plied is towards the improvement of the’ 
examination procedure. 

In both these investigations the final 
recommendations as to the choice of an 
occupation were the outcome of a survey 
of the child’s general physical, mental, 
and temperamental condition as de- 
termined by his school marks, by per- 
formances in special tests, and by oral in- 
terviews. The London Experiment 
showed that children of even the poorest 
classes of city workers could be success- 
fully advised, though the specific value of 
each part of the total procedure was not 
directly ascertainable. The Birmingham 
Experiment suggested that the special 
psychological examination may be 
shortened without loss whenever more 
trustworthy school records can be ob- 
tained and whenever the advisory work 
can be made an integral part of the school 
life. 

But neither experiment could deal 
with the further question of the ade- 
quacy of one single ‘‘cross section”’ of the 
individual. Is it sufficient to judge the 
individual as he is at 14, or 15, or 16? 
Or is it better to study him during growth 
from infancy? If so, at what stage should 
the definitely vocational problems be 
seriously considered? 

These questions can only be answered 
by research in which special studies are 
made at different stages of growth, but 

*The Value of Vocational Tests as Aids to 


Choice of Employment, E. P. Allen and P. Smith. 
Birmingham, Education Commitiee, 1932. 
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this is obviously a task that should occupy 
many minds for many years. One such 
experiment, in which psychological 
studies began at the age of 11, was begun 
in the County of Fife by the National 
Institute of Industrial Psychology five 
years ago and a report of the results is 
expected some time this year. Meanwhile 
we may contemplate with some satisfac- 
tion the fact that the issues are now con- 
siderably clearer than they were. We are 
no longer hypnotized by the compilers of 
“intelligence” tests into the belief that 
they all measure the same abilities, or 
that a “general ability” test will be of 
any diagnostic value in a situation in* 
which specific abilities predominate. We 
do not expect that a test which gives a 
reliable measure of an ability at one age 
or with one sex, will necessarily be of 
equal value at another age or with the 
other sex. We know or we suspect that 
some tests (Performance Tests, for in- 
stance) are likely to be better measures of 
“general ability’’ at one age than at an- 
other; that other tests (Mechanical Abili- 
ty, for example) are more useful for boys 
than for girls. Facts like these emphasize 
the grave dangers that lie in a guidance 
procedure which employs a very limited 
psychological examination and which 
fails to discriminate between the re- 
sponses of individuals of different sex, 
age, and training. But they also show 
that we have advanced in our conception 
of what vocational guidance means. 


IV 


Development in the future undoubtedly 
requires the elucidation of a number of 
doubtful points concerning the changes 
in the abilities of an individual from age 
to age, the differentiation between specific 
and general abilities, the minimum quali- 
fications for particular kinds of work, and 
the like. Then there is the place of the 
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school record and how it can be im- 
proved. Systematic school records will 
show what has happened from stage to 
stage, and while it is important to know 
what the boy or girl is mow, it may be 


equally valuable to know how he came to . 
Especially is this so in ab-. 


be as he is. 
normal cases. It is not difficult to en- 
visage a time when a diagnostic exam- 
ination of some special ability may be 
given at a particular stage in the child's 
development as a clue to the next step, 
and from a series of such examinations 
over a period of years, combined into one 
comprehensive and systematic psycholog- 
ical survey, to formulate a vocational 
recommendation of the highest signifi- 
cance and value to the individual con- 
cerned. 

It follows, therefore, that psychological 
examinations that are worth while cannot 
be successfully introduced into the study 
of individual human beings by any per- 
son who imagines they will be useful 
short cuts. The student of human be- 
havior must be trained and experienced, 
though this does not necessarily mean 
that he must be a highly skilled psychol- 
ogist. A person who brings interest and 


sympathy into his relations with human 
beings and who possesses the ability to ‘ 
comprehend all the issues involved, can 
readily be trained to carry out this kind 
of work.® 

Needless to say, it is to be hoped that 
everyone who attempts vocational advis- 
ing will be thus qualified. It is not 
necessary to have a detailed knowledge 
of statistical techniques and the elaborate 
procedures of the research worker. Nor ' 
is it necessary to procure highly elaborate 
or expensive apparatus and equipment 
Much valuable work can be done in a 
quiet and modest way by an intelligent 
and systematic use of those sources of in- 
formation which are very often neglected 
because they are so familiar, viz., the day-' 
to-day activities of the individual. Prop- 
erly recorded and interpreted, and sup- 
plemented by observations obtained in 
situations specially devised to throw light 
upon particular aspects, the peculiarly 
personal activities of the individual form 
the best and safest foundation for offer- 
ing advice. 





5 See “The Training of Teachers in Psychological 
Testing, by E. P. Hunt and P. Smith, in The 
Human Factor, January, 1934, Vol. VIII, No. 1 
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research in guidance there are several 

fundamental points which must be 
discussed as a preliminary to the setting 
out of the theory. 

In the first place we had better make 
clear what we mean by guidance and 
what different fields of research must be 
included in a guidance program. 

In the second place we should do well 
to examine the basis on which guidance 
rests at present, indicating in what re- 
spects we consider that to be inadequate 
and where we hope to increase the value 
of that basis. This must involve some 
discussion, however brief, of existing 
theories and of previous researches. We 
cannot discuss these at all adequately in 


I’ SUGGESTING a theoretical basis for 
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such a short paper, but by selecting points 
of view as representative as possible, we 
may be able to clear the path for the 
presentation of the suggested theory so 
as to place it against the background 
from which it has sprung. We hope that 
it will be appreciated that our discussion 
of previous work and existing theories is 
not intended to be exhaustive. It will 
not attempt to evaluate all work done nor 
even the important work in all fields. We 
shall simply suggest the principal lines of 
thought that we see to underlie present 
work in the field. 

Our purpose may be defined as the 
presentation of a suggested theory for re- 
search in guidance, not as proved, but 
rather as worth proving. 
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II 
Wuat Is GUIDANCE? 

Guidance, as we see it, is dependent 
for its success on three fields of investiga- 
tion. First, it depends on a knowledge 
of the individual; second, on a knowledge 
of the situation in which the individual 
is to function; and third, on the tech- 
niques by which we bring these two 
spheres of knowledge together. The first 
of these is the field of educational and vo- 
cational psychology, the second is the field 
of industrial and educational sociology, 
the third is the field of guidance, both 
educational and vocational. The essential 
purpose in guidance is to make the in- 
dividual aware of himself, and also aware 
of the situations in which he could func- 
tion fully, could realize himself to the 
greatest degree, and live both happily and 
successfully. 

To be successful in guidance, then, we 
must have adequate research in all three 
fields. If our individual analysis is in- 
complete, if our occupational analysis is 
incomplete, or if our techniques are in- 
adequate we can succeed only partially. 
Advance must therefore take place along 
a coordinated front. Good guidance 
means good individual analysis, good oc- 
cupational analysis, and good guidance 
technique. The realization of the inter- 
dependence of these three fields is funda- 
mental. 

Now it will be clear that if there is to 
be close integration of the different fields 
of research it is of vital importance that 
we shall use the same set of terms in 
each field. If we conduct our individual 
analysis in one set of terms and our oc- 
cupational analysis in another set of 
terms, the work of fitting these two to- 
gether is nearly hopeless. This is a point 
in which I suggest we have failed until 
now. Too often occupational research 
deals in terms which either have a differ- 


ent connotation when used in individual 
analysis, or else are absent from individ- 
ual analysis altogether. To know that a 
person has certain ratings in A, B, and ¢ 
is little help if we only know the needs 
of the situation in terms of ratings in D 
E, and F. It seems an obvious point, too 
obvious to need stress, yet it is too often 
disregarded. 

Our requirements in guidance may 
then be set out briefly as these: A com- 
plete and accurate individual analysis in 
a definite set of terms, a complete occupa 
tional analysis in the same set of terms, 
and as perfect guidance techniques as can 
be attained. Such an aim seems almost 
impossible of achievement and perhaps it 
is so. As we approach most nearly to that 
aim we shall fulfil the needs of guidance 
The purpose of this paper is essentially to 
suggest a set of terms which, were re 
search based on them, would, in our opin- 
ion, lead to a greater realization of this 
aim than we have yet achieved. 


Ill 

THE PRESENT BASIS FOR GUIDANC! 

I should almost certainly have made 
this heading in terms of bases rather than 
basis. It would appear that there are sev- 
eral bases for guidance suggested. By 
basis I mean really the set of terms which 
are to be used, for obviously, that is the 
fundamental issue. 

Let us look for a moment at the prob- 
lem of individual analysis. It appears 
that there is basic disagreement among 
eminent psychologists as to the nature of 
the unities in which such an analysis 
should be made. Keeping within the 
sphere of abilities we can find at least 
three positions held. There is first the 
theory of Spearman’ which lays stress on 
the fact that in this sphere there is one 


1 Abilities of Man, C. Spearman. Macmillan, 
New York, 1928. 
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general factor which he calls “g,”’ and a 
large number of specific factors each of 
them independent of the others, and all 
of them independent of “g.” On this 
basis we shall consider principally meas- 
urements of “g,”’ and according to the in- 
dividual’s rating in “g” we place him in 
that situation in which such a rating in 
"g”’ is necessary. As a part of any basis 
for guidance this is obviously necessary, 
since what we are saying really is that 
general intelligence is an important factor 
in guidance. That it is so is admitted 
everywhere. However there is really a 
fundamental problem involved here be- 
cause there are many equaily eminent psy- 
chologists who disagree with this funda- 
mental point in Spearman's theory. For 
example, there is the attitude of a whole 
school of psychologists—Thorndike, Pat- 
erson, Toops, Hull, Kelley and many 
others—who have suggested what they 
describe as the theory of unique traits. 
This theory describes abilities in terms of 
a limited number of largely independent 
traits, but has no place for a quite gen- 
eral factor such as is indicated by Spear- 
man. Their unique traits do in fact over- 
lap somewhat, showing that there is 
something in common between any two 
of them, but in so far as the amount in 
common is small they can be fairly de- 
scribed as largely independent. It is 
claimed that this theory “not only sim- 
plifies and clarifies the assumptions 
underlying much of the work of testing, 
but makes the specifications of the task 
definite and introduces order into the 
practical procedure.” 

It is true that it is intended to do so, 
but it will be suggested that it must fail 
unless the unique traits are guite inde- 
pendent. That this is so can easily be 


2 Minnesota Mechanical Ability Tests, Paterson, 
Elliott, Toops, e¢ a/. Univ. of Minnesota Press, 


Minneapolis, 1930. p. 14. 
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shown and is in our opinion a funda 
mental point for research in guidance. If 
these traits are not quite independent then 
it follows that the measures of them are 
measures of composite things, not of 
unitary things. As such the scores on 
these measures may be utterly misleading 
in many cases. . 

Let me take as an example one with 
which all my readers will be familiar 
We use as a measure of “General Intel 
ligence’’ verbal group scales such as the 
Otis, the Terman, and so on. Now such 
a measure meets the requirements of the 
unique trait school quite admirably. To 
quote from that workmanlike book from 
Minnesota on mechanical ability tests 
“positive correlations with the criterion 
will tell what the trait is; low correlations 
with other traits show that it has been 
successfully disentangled from its unnec- 
essary concomitants.”* There is the 
criterion. Let us now go back to such a 
test. It will probably be admitted that a 
sound criterion for general intelligence is 
progress in school work taken generally 
With such a criterion our ‘Verbal 
Scale’ will have a correlation coefficient 
in the region of .6 probably, and there- 
fore shows a satisfactory agreement with 
the criterion; on the other hand, it will 
show a low correlation with other traits 
as, for example, the trait of mechanical 
ability as defined and measured by the 
Minnesota Test battery. We may find in 
this case a correlation as low as r=.1 or 
.2. In fact, these are approximate correla- 
tions to be found in the Minnesota data.‘ 
It must be assumed by such workers then 
that our “Verbal Scale’’ is an adequate 
measure of general intelligence. In our 
opinion that is fundamentally wrong for 
guidance progress. Why? Here is the 
reason. It can be shown clearly that a 


3 Op. cit, p. 15. 
4 Op. cit, p. 246 and p. 247 
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test such as the “Verbal Scale’ does not 
measure one thing, it measures a com- 
posite of two factors or traits. In this 
particular case we find that it is just this 
fact that leads to so much difficulty. Let 
us try to make this point clear. We argue 
that in guidance a test must measure one 
thing. We suggest that this is possible, 
and we indicate later a theory on which 
research would yield such measures. This 
is imperative because otherwise we shall 
not be able to tell how much of the score 
in the test is attributable to the different 
factors playing a part in the composite. 
Suppose, for example, we use a measure 
such as this and get two men with equal 
scores in the test. That may not mean 
they have the same “general intelligence.” 
One may have more than the other, but 
the verbal factor which also plays a part 
in the test has allowed the compensation 
in the total score to take place. 

This point will come up later and will 
be made quite clear when we set out the 
factors as we see them to exist and dis- 
cuss the relationship between functional 
abilities and psychological factors. Mean- 
time let us continue with our discussion 
of existing bases. 

While we have included Hull and 
Thorndike as supporters of the theory of 
unique traits as sponsored by the Minne- 
sota school, we feel that Hull* especially 
is perhaps a greater specifist than the 
others. He appears to cling to the belief 
that aptitudes are particular, not in any 
way general. As we see it, this is due to 
the fact that Hull is thinking of func- 
tional aptitudes and not of psychological 
factors. The distinction which this im- 
plies will be discussed in greater detail 
later. It must be borne in mind that 
Thorndike, who is the father of this 
whole school, started with the specific 


5 Aptitude Testing, Clark L. Hull. World Book 
Co., New York, 1928. 


theory. He moved towards a trait theory, 
at least for practical purposes of testing. 
In 1920° we find him suggesting that 
there are three broad spheres of ability 
which we must consider. These he called 
Practical Intelligence, Verbal Intelligence, 
and Social Intelligence. Again it seems 
to us that while this is sound functionally, 
there is real danger of us being misled if 
we do not recognize that each of these is 
a composite, not a unity. They are not 
distinct abilities. Each has much in com- 
mon with the others. We explain that 
later, but perhaps we may anticipate and 
suggest that Practical ability is a com- 
posite of two factors “g” and P, Verbal 
ability is a composite of two factors "g” 
and V, and Social ability is a composite 
of “g’” with certain S factors. In each 
case the “g’’ we use is the same. The 
definition of these factors is contained in 
the description of our theory, so we will 
leave the matter there. We are stressing 
really a difference which is rather funda- 
mental, viz., the difference between func- 
tional abilities and psychological factors. 
The abilities are syntheses of the factors. 
If we adopt the abilities as unitary traits 
for measurement we are measuring com- 
posites and will meet the difficulty we 
have already stressed. Let me illustrate 
what this means once more before we go 
further. Suppose we accept the concept 
of verbal ability and set up a measure of 
it. Now we go to some occupation to 
find the requirements in this ability. Let 
us take policemen. We find that a score 
of 100 in such a test is necessary for 
policemen. We select an individual, 
“A,” who scores 100 and suggest that he 
be a policeman. (There are many other 
things involved, but we are allowing them 
to be considered as suitable meantime for 
simplicity.) The individual, “A,” fails 
6 “Measuring Human Intelligence,” E. L. Thorn- 
dike. Harpers Magazine, January, 1920. 
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as a policeman. Why? Because the test 
is measuring a composite, it may be that 
the policeman we tested scored 100 due 
to 80 points from “g” and 20 from V. 
Our individual, “A,” scored 100 due, 
however, to 60 points from “g” and 40 
from V. Now it may well be that V is 
of little importance to policemen and 
what is needed is really a minimum of 80 
points of “g.” Our individual, “A,” 
fails because he has only 60 points of 
“g.” We were not able to tell that be- 
cause we were using a composite measure. 

It is for that reason that we cannot be 
content to accept the point of view of 
Hull or of Thorndike. Yet it is true that 
functionally we are thoroughly justified 
in speaking of such abilities. We must 
not measure abilities and only these, we 
must measure factors, which have unity 
in a different sense. In the sphere of per- 
sonality there is need for greater advance 
than in the sphere of abilities. We have 
had many tests of various personality 
traits (using that phrase functionally) 
which have been more or less helpful. In 
every case there is the same problem that 
we have stressed in the sphere of abilities, 
viz., the problem arising from the use of 
composite measures. We have measures 
of Fair-mindedness, of Dominance, of 
Excitability, and so on. These are cer- 
tainly all composites. They result from 
certain syntheses or combinations of cer- 
tain personality factors. These factors 
we discuss later. 

Perhaps no better work has been done 
in this sphere than that of Cattell." Here 
we have an attempt to find the factors in 
personality. In producing tests Ameri- 
can psychologists have gone far. The 
Bernreuter® test is an excellent example. 


' British Journal of Psychology, Vol. XXIV, 
1933. “Temperament Tests, II Tests,” R. B. 
Cattell. 

8 Personality Inventory, R. G. Bernreuter. Stan- 
ford University Press, 1930. 
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As for having a theoretical basis un- 
derlying the preparation of such tests, 
there is none. As is said in Minnesota 
Mechanical Ability Tests already referred 
to, ‘“Most often there is not even an in- 
direct reference to the possibility of meas- 
uring human personality in all its as- 
pects.” Later we find a criticism regard- 
ing “vague references to the important 
role of intangible character qualities.” 
The Minnesota group recognized the 
needs of this sphere. They are great in- 
deed. In our theory we include the whole 
of human personality, and we believe that 
in so doing we open up very great pos- 
sibilities for guidance. 

Speaking very generally, then, we may 
say that the basis on which guidance rests 
at the moment is largely confined to cer- 
tain traits in the ability sphere and that 
these are not measured successfully be- 
cause there are in use only composite 
measures. Further we have to recognize 
a difference in the recognition of a gen- 
eral factor as most vitally important by 
Spearman in contrast to the absence of a 
general factor in the theory of unique 
traits, held by Thorndike, Paterson, 
Toops, Hull, and Kelley. No discussion 
of this sphere of work, however brief, 
can omit a special reference to the work 
of Kelley. He has made very notable 
contributions to the field, and we believe 
his book Crossroads in the Mind of Man* 
to be perhaps the most exhaustive discus- 
sion of the problems we have read. Apart 
from Spearman's Abilities of Man we can 
find no discussion of such value. In that 
book Kelley seems to reach a position es 
sentially similar to that of Hull, Toops 
and the others of the unique traits group 
except that he has, in our opinion, a much 
better statistical basis for his conclusions 
than is given in the Minnesota work 


® Crossroads in the Mind of Man, T. L. Kelley 
Stanford University Press, 1928. 
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He is very definitely concerned with 
unitary traits and his method of assessing 
these is statistically valid. He, too, can- 
not find place for a general factor, but 
here we have a different argument and 
probably a more valid one. The argu- 
ment takes the form that the general fac- 
tor is dependent on the particular set of 
tests used in establishing it. In the earlier 
stages of Spearman’s work we believe 
that argument to have had complete val- 
idity. Today we consider that difficulty 
can be overcome. It is true that, unless 
the number of cases is very large, tetrad 
analysis (as used and defined by Spear- 
man) may fail to reveal a group factor 
and thus make “g’”’ dependent on the tests 
used. For example, Spearman found only 
that general factor in verbal intelligence 
tests at one stage. Later, however, Ste- 
phenson’? working under Spearman, 
found that such verbal tests did not sat- 
isfy the criterion with large numbers, that 
in fact such tests were a measure of two 
factors (apart from specific factors) 
which could be called ‘‘g,” the general 
factor, and V, the verbal factor. On the 
other hand, they found that they had in 
their perceptual tests a measure which 
correlated to the remarkable extent of .99 
with “g” and had no other factor present 
at all. In fact they had discovered a true 
measure of “g”’ and of “g” only. Now 
here is an important point. If we allowed 
“g” to be defined as “that factor meas- 
ured by this perceptual test battery,” ob- 
viously since this is a measure of a single 
thing, “g’’ would remain constant. It is 
the case that such a procedure would be 
thoroughly practicable and would un- 
doubtedly mean a constant general factor 
and a measure that would concern only 
one factor. That we suggest is the basis 





10“*Tetrad Differences for Non-Verbal Tests,” 
W. Stephenson. Journal of Educational Psychol- 
ogy, Vol. XXII, 1931. 


of our procedure. Further we suggest 
that argument as to whether there is a 
general factor is wholly unnecessary. 
Surely, as Thurstone says, the fact that 
we cannot get any pair of tests that are 
likely to be measuring intelligence to cor- 
relate negatively is ample proof that there 
is such overlap as can be interpreted as 
belonging to one factor. At the func- 
tional level it 7s one factor no matter how 
it may be otherwise interpreted. 

In a word, we suggest that the differ- 
ences in the existing theories are resolv- 
able and that the essential truths con- 
tained in all of them will be found in 
the theory we here outline. We find 
room for a general factor defined as a sta- 
tistical entity and measured best by per- 
ceptual tests such as have been used by 
Spearman and Stephenson."' We also 
find room and evidence for the existence 
of several group factors or unique traits 
and further, and most important, we sug- 
gest a theory as to the number of factors 
involved in personality and the explana- 
tion of interests which are so much dealt 
with in the work of Professor Strong.” 
In fact, we presume not so much to offer 
a new theory as rather to restate existing 
theories with an extension to the field of 
personality inspired by contact with Pro- 
fessor Thurstone. Our emphasis on per- 
sonality is, we consider, vitally important 
As we see it, much of the difficulty in 
securing tests in this sphere is removed by 
the presentation of the methods of analy- 
sis in “Multiple Factor Theory” by Thur- 
stone.'* We shall not be free to discuss 
the question of method, but by adding an 
appendix indicating the type of evidence 


11 We understand that Spearman will publish 
very shortly such a test under title Visual Percep- 
tion Tests. 

12 Manual for Vocational Interest Blank, E. K 
Strong, Jr. Stanford University Press, 1933. 

18 Multiple Factor Theory, L. L. Thurstone. 
Edwards Brothers, Ann Arbor, Mich., 1933. 
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on which the theory is based and the road 
along which the complete solution will be 
found we hope to indicate where its 
strength seems to us to lie. 

Let us summarize what has been said 
here before we outline our theory. We 
have stressed the need for integration of 
the research work in different fields. We 
have stressed the need for using one set 
of terms. We have stressed the need for 
using terms which are unitary and meas- 
ures which assess one trait or factor. We 
have briefly indicated our belief that this 
can be done through multiple factor anal- 
ysis‘* and, probably, the use of tetrad 
analysis in conjunction therewith. We 
have suggested that we must hold our 
terms or factors constant by defining them 
in statistical terms and validating meas- 
ures of them after the fashion of the per- 
ceptual tests of Spearman and Stephenson. 
Now we proceed to the task of setting out 
the theory on which we believe guidance 
should rest and in which we might have 
a complete picture of human personality 
and ability such as is really needed but 
which seems so hopeless of attainment. 


IV 
HIERARCHICAL THEORY 


We choose the name hierarchical the- 
ory to indicate that it is not monarchic, 
having one general factor and the rest 
quite subordinate; nor anarchic, in the 
sense of having a very large number of 
factors of more or less narrow nature: 
nor again oligarchic, in the sense of hav- 
ing a limited number of factors of more 
or less equal importance; but rather hier- 
archic, since it has one general factor and 
moves from there through an increasing 
number of factors of less breadth to the 


‘# See footnote 13, also A Simplified Multiple 
Factor Method, L. L. Thurstone. University of 
Chicago Bookstore, 1933. 
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large number of specifics of special inter 
est in one reaction only. 

Our basic conception is that the abili 
ties and personality traits of man are 
functional unities at different levels. Thus 
in the last analysis ‘I’ am a unity. Fur- 
ther we see that all such functional unities 
as abilities and personality traits and in 
terests and so on are resolvable into a 
limited number of psychological factors 
as defined by statistical analysis, and that 
these factors are single entities in a new 
sense since they are not resolvable by sta 
tistical analysis but are the wits which 
synthesize or combine to form all fun 
tional abilities, interests, and so on. Fur 
ther we consider that these factors can be 
represented as hierarchical in arrange 
ment varying from the one factor “g” 
which plays a part in all cognitive expe 
rience to the large number of specific fac 
tors which play a part in only one such 
experience. All these factors are inde 
pendent of one another and of “g” and 
in terms of them ail abilities, personality 
traits, and interests can be explained. Be 
tween the general factor and the specifi 
factors are factors which vary in their 
breadth, and according to their breadth 
they find their place in the hierarchy. By 
breadth we mean the number of life situ- 
ations in which they play some part. We 
realize that the importance of a factor in 
different situations may vary greatly. Thus 
in one situation “g,” for example, may be 
quite the most important factor present, 
whereas in another it may play a very 
minor role compared to certain other 
factors. 

This conception may be represented 
diagrammatically as shown on page 82 

It should be noted at this point that the 
placing of these factors in this diagram is 
purely tentative. Further resear h must 
decide their placement according to their 
breadth. Here we are concerned to illus- 
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trate the basic concept rather than to place 
absolutely those factors for the existence 
of which there is already evidence. (The 
work of the Differential Traits Commit- 
tee will be a very great contribution to 
the completion of such a diagram as we 
are here suggesting. ) 

In the diagram the factors are grouped 
horizontally according to their breadth. 
Thus a broad factor playing a part in 
many life situations will be found near 
the apex of the hierarchy while on the ex- 
treme side we find the specific factors 
which play a part in only one situation. 

At this stage we may make clear cer- 
tain distinctions in terminology which are 
important. By factor we mean an entity 
defined statistically and being one of the 
factors in our hierarchy. Factors are 
therefore not functional but are statistical 
entities having a psychological signifi- 
cance. We use the term ability only in a 
functional sense. Thus we speak of 
mathematical ability meaning that syn- 
thesis of factors which functions to en- 
able a person to do well in the study of 
mathematics. Abilities are therefore al- 
ways composite. Practical ability means 
the functional ability that leads to suc- 
cess in the world of things. The practical 
factor means that factor in our hierarchy 


which along with “g’’ and maybe other 


factors functions as practical ability. Or 
again verbal ability will be functional 
ability that makes for success in school 
work. The verbal factor will be that fac- 
tor which along with “g’” and maybe 
other factors functions as verbal ability 
We must note therefore that when we 
say ability we refer to a functional thing 
which is always a synthesis of two or 
more factors. The factors are the psy- 
chological unities. 

By breadth we mean the number of life 
situations in which a factor plays some 
part (whether more or less important). 
In fact, the importance of a factor varies 
from one situation to another, but as long 
as it is playing some part in a situation it 
ranks as being present. The broadest 
factor is ‘'g” of course, while s factors are 
the narrowest. 

Now let us examine the diagram and 
indicate, at least tentatively, the signifi- 
cance we attach to these letters. In ac- 
cordance with the concept of breadth we 
have arranged the factors in a hierarchy 
On the left we find “gz,” which we may 
call the general factor, as the broadest 
factor of all. It is so placed because we 
find that it plays a part in all cognitive 
experience—sometimes, indeed often, a 
most important part, sometimes less im- 
portant, but always it is there. 

The symbol v follows and represents 
the verbal factor. This factor is inde- 
pendent of “g” and along with “g’”’ func- 
tions as what we may call verbal ability 
(a functional ability). It is this ability 
we appear to have been measuring with 
our usual verbal scales of intelligence, 
and it is just because we have been meas- 

uring this functional ability comprising a 
composite of two factors, viz., “‘g’” and v, 
that the problem referred to above in 
terms of composite measures has been so 
marked. For example, it is a recognized 
thing that the use of such verbal scales 
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has been much more successful in school 
guidance than, say, in vocational guid- 
ance. The reason is simply that whereas 
school ability is dependent on both fac- 
tors involved in the test, in many cases 
vocational success is dependent only on 
one and not on the other and so our com- 
posite measure is inadequate. 

P is placed alongside v for breadth 
and represents what we may call the prac- 
tical factor, P is independent of “g’’ and 
along with “g’” functions as practical 
ability, the ability which makes for success 
in the practical world, the sphere of 
things rather than of words or symbols. 
Notice again that our measures, such as 
performance tests of intelligence, are 
measuring composites, in this case “g” 
and P, and again will cause us to be faced 
with the problem already referred to. It 
is to be noted that until now research 
directed to establishing the existence of a 
unique factor common to performance 
tests has been inconclusive. 

The writer has evidence which estab- 
lishes the existence of this P factor. This 
evidence cannot be included here, indeed 
no evidence is being included because of 
the nature of this paper, but it is hoped 
that all such evidence will be in published 
form sometime in the fall of 1934. Our 
concern here is with the interpretation of 
that type of evidence. 

The letters m, n, R are used to repre- 
sent factors which we may call respec- 
tively, mechanical factor, number factor, 
and reasoning factor. These are prob- 
ably of less breadth than P and v and are 
therefore placed as shown in the diagram. 

Before going over the S factors which 
are perhaps the most important part of 
this theory, let us run over those factors 
which are already described and indicate 
references in literature. The “g” factor 
is, of course, that established by Professor 
Spearman and over which there has been 


[ 83] 


so much controversy. Indeed in his book, 
The Abilities of Man, Spearman cites 
several group factors which have since 
been established. It is to be noted that 
whereas “g”’ as defined initially by Spear- 
man was said to be measured by verbal 
scales as a single entity, it is not, in terms 
of the true definition, measured alone, 
but in synthesis with v, in verbal tests 
Perceptual tests such as used by Stephen- 
son and Spearman are the best measure 
of “gz.” Verbal scales measure “g’’ and 
v together. It is just because this is so 
that we find the difficulty noted above 

The factor v emerged from the work 
of Stephenson'* conducted under the 
guidance of Spearman. It was also es- 
tablished independently by Kelley. 

The P factor has emerged from the 
work of the writer and his evidence for 
that will be published later in 1934. In 
the appendix will be found one sample of 
evidence. 

The factor m representing mechanical 
ability has been established by Cox"* using 
a tetrad approach and again essentially by 
Paterson, Toops and others’ at Minne- 
sota in their mechanical abilities work 
there. The Minnesota results indicate 
more than one factor in this sphere. 

The » factor will be found referred to 
in Kelley’s Crossroads..* Again Kelley, 
like Spearman, has indicated and shown 
evidence for several factors. But as be- 
fore we may need to define these factors 
according to the analysis we make, so that 
they shall not be dependent on the tests 
used but rather that the tests devised at 
any time will be shown to measure cer- 


15 *Tetrad Differences for Verbal Subtests Rela- 
tive to Non-verbal Subtests,”” W. Stephenson. 
Journal of Educational Psychology, Vol. XXII, 
1931. 

16 Mechanical Aptitude, Its Existence, Nature 
and Measurement, J. W. Cox. Methuen, London, 
1928. 

17 See footnote 2. 

18 See footnote 9. 
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tain combinations of the factors already 
defined. Of this more will be said later. 
The R factor has recently been shown to 
have existence by Murdoch’® working in 
London. 

The factors 5,, 5», 
specific factors so often referred to, and 
as such need no source in literature. They 
are agreed on as existing by all, to the 
best of my knowledge. We may disagree 
on their importance, though again it is a 
matter of the particular situation. They 
are important in some cases, in others 
they scarcely matter. Since the possibility 
of assessing all of them in any one indi 
vidual is almost hopeless, we must con- 
sider the broader factors as more impor- 
tant in general, and watch that our ratings 
of these are not made invalid by the ab- 
sence or presence of a specific s in a cer- 
tain situation. Thus according to what 
we propose to do in a particular case we 
must measure the specific factor for that 
situation before saying it is suitable. A 
boy may have the right amount of “g 
and v and P and all the others to do well 
in a certain situation but lacking the s for 
that very markedly, he may fail. To 
cover this we measure that s but not all 
his s’s. 

Now let us discuss the factors S,, S,, S,, 
S,, S,. These represent five personality 
factors. Professor Thurstone has tenta- 
tive evidence that five factors are all we 
need to explain personality variations. 
The writer has further evidence that a 
sma!l number of factors is sufficient. (We 
do not commit ourselves to five. It may 
be six or seven, but we take five mean- 
time.) Now that does not mean that there 
are only five kinds of personality—far 
from it. By different combinations of 
different amounts of these factors we get 
an infinite number of different kinds of 


and so on are the 


19 An unpublished thesis in the University of 
London Library. 


personality. 
ality we only need certain loadings of five 
factors. That is very important. Further 
and more important, we can and must 
validate tests in terms of these factors. so 
that we are again measuring single enti 

ties and can load them in proper amount 

to get the personality as a whole. This 
can be done statistically just as Spearma: 
produced a measure of “g”’ which we bx 

lieve to be quite satisfactory. 


But to get any one persor 


I have been asked always when I have 
lectured on this idea ““What are the five S 
factors?” The answer is that they hay 
to be fixed according to future research 
We can make one of them what we wish 
and immediately two are fixed because 
they are independent or orthogonal. Let 
me put it this way. I am suggesting that 
a man be represented as a point on a fiv: 
dimensional spherical surface. His per 
sonality will be represented by the radiu 
to this point. The principal axes of th 
sphere represent the factors and are or 
thogonal and five in number. Now ob 
viously we may rotate these axes and ir 
so doing will alter the projections of th 
radius on the axes representing the p 
sonality, but we do not alter his positior 
in the sphere. Thus we may alter the 
names of the factors and the loadings of 
them possessed by this man, but really w: 
have not altered the personality of the 
man. Now clearly we must, as in the cas: 
of the other factors, hold these constant 
This can be done by agreeing where it 
will be best to fix these axes, a matter 
done on an arbitrary basis with a view to 
making them best for practical purposes 
of guidance. Having once fixed them 
they are held constant, and any new test 
suggested in the sphere of personality or 
in any other sphere is studied to see how 
it correlates with our factors. According 
to these correlations we can tell what is 
its best use. Just as we know that a 
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verbal scale such as the Terman Group 
Test is a measure of “g” and v, and fur- 
ther that this combination is rather impor- 
tant for school work, though not nearly 
so important for vocational work in most 
cases, So we may find that, say, the Bern- 
reuter Test is a measure of S, and S, and 
that as such it can be used—always real- 
izing that it is a measure of a composite 
kind and should be best resolved into its 
elements. So also with g” and v. We 
have, I suggest, a measure of “g’’ in per- 
ceptual tests. We must now set about 
validating measures of v and of P and of 
m, and so on, as far as possible independ- 
ently of “g,” and if they are not wholly 
independent as measures, then we must 
allow for the effect of “g” and find the 
true measure of » or m or whatever it ts 
we are wanting to measure. One of the 
great contributions of the Minnesota work 
is that it has provided a measure 
which is undoubtedly a measure of “g” 
and m in combination but which is largely 
saturated with m. Allowing for the ef- 
fect of “g’”’ we can get from it a measure 
of m that will probably prove to be thor- 
oughly sound. Not to take account of 
oe” will leave it a composite measure 
with the same dangers as in the case of 
verbal scales applied to industrial work. 
That is our theory for research in guid- 
ance. We have discussed it with Pro- 
fessor Spearman, with Professor Thur- 
stone, and with others. There seems to 
be a large measure of agreement. Un- 
fortunately for us, we were prevented by 
time from discussing it with the Minne- 
sota group. We did, however, have an 
opportunity of discussing it with Terman 
and a group at Stanford and again found 
considerable agreement and interest. Most 
interesting is perhaps the fact that Tryon*° 
20 “Multiple Factors vs. Two Factors as Deter- 


miners of Ability,” R. C. Tryon. Psychological 
Review, Vol. 39, No. 4. 
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at Berkeley was sympathetic to it. His 
work in genetics has made him a very 
strong opponent of the two-factor theory 
of Spearman. As I see it, we have a 
functional system of abilities, interests 
and so on which can be resolved into a 
psychological factor hierarchy. It may be 
that this hierarchy can be resolved into a 
genetic system of entities and make a still 
more scientific basis for guidance. The 
problem is which of these systems is most 
valuable for guidance work now, and my 
suggestion is that this system of psych 
logical factors is best To use a system of 
functional abilities is to allow mp 
measures to be used as wnities in guid 
ance, and that must result in inefficiency 
Let me expand this concept by discuss 
ing the interest sphere. It is true that we 
talk, to take an example, of an 
in people.” Professor Strong indicated 
such an interest as important in a lectur 
at the Guidance Conference at Stanford 


interest 


| appear to have omit 


he > he iT} 


in the summer. 
ted interest altogether from t 
of things. That is not so. Interests are 
in my opinion, functional. That is to say 
any interest, such as ‘‘interest in peop! 

is the synthesis in the individual of cer 
tain factors as indicated in our diagram 
Perhaps ‘‘interest in people” is, say, duc 
to a certain amount of S, and S, alor 

with “g.”’ Let us make this clear. Let 
us be quite extravagant for a moment 
Suppose we find that it is possible to de 
fine S, as dominance 


assumes dominance to be a unitary psy 


(notice that this 


chological factor which may or may not 
be true 
the same way let us suppose we find S$ 
may be defined as extraversion. In actual 
fact, we shall never so define our factors 


probably it is not true) and in 


since this is using terms which are in 
popular use and are ambiguous. Now 
suppose we find that “interest in people” 
is due to high S,and high S,. That is to 
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say “interest in people” as a functional 
entity, is resolvable into so much domi- 
nance and so much extraversion which are 
psychological factors S, and S,. When 
we find high S, and high S, we know that 
this person will be interested in people. 
What about ‘g’’? 
mines the level on which this interest in 
people will find suitable expression. A 
person with high S,, high S,, and high 
‘*g’”’ may be an excellent professor of edu- 
cation, or teacher, or personnel officer. A 
person with the same S, and S, and there- 
fore “interested in people’ but with low 
‘'e”’ may well make a real success as a 
shop assistant, or some such thing where 
it can be shown that his “'g” is enough for 
success in salesmanship of that kind and 
where this interest in people is necessary. 
The hope is that we are going to be able 
to make virtually an equation for a man 
and an equation for an occupation in the 
same terms, which will be so complete 
that guidance may be said to be scientific. 
These terms we are here suggesting. 
Notice that in the discussion of the 
significance of ‘g’’ above we have men- 
tioned a vital point in guidance. Interest 
being functional, it is often indicated by 
people in terms of specific occupations. 
Yet it is obviously true that for any inter- 
est there are several outlets. When a 
boy says he wants to be a teacher because 
he is interested in teaching, he really does 
not mean that. He probably means that 
he wants to be a teacher because he is 
“interested in people.” If we find then 
that his “g” is too low for this occupa- 
tion, we must introduce him to those 
other spheres where “interest in people” 
can find suitable expression and which are 
suitable to his level of “g.” That is 
guidance. As the generations pass the 
ways in which various interests can be 
expressed change, but the essential nature 
of the interests does not change because 


it is dependent on the psychological fac- 
tors which are in the individual. We are 
prone, however, to express ourselves not 
in terms of these true functional interests 
as “interest in people’ or “interest in 
things,’” or maybe, “interest in words,” 
but rather as interested in teaching, or 
interested in engineering, or interested i: 
literature. These are particular spheres 
of expression of the other interests, and 
they in turn are due to certain ratings in 
our psychological factors in the indi 
vidual, influenced probably by experiencc 

Briefly, then, that is our theory. Let us 
just add a word as to how we should like 
to see research conducted. 


Vv 
FUTURE RESEARCH 


First, we would suggest that to be su 
cessful future research must be integrated 
by some central body. I mean that re 
search in the different fields must be so 
controlled that all the findings in all the 
spheres, either individual or occupational 
are in the same terms. In America the 
National Occupational Conference looks 
like the body that must perform that 
function, while in Britain I look to the 
National Institute of Industrial Psycho! 
ogy in London to take the same place. 

Second, we must conduct one research 
which shall take in the whole field of 
abilities and personality at one time. This 
is essential if we are to establish factors 
which will be independent. To do re 
search in abilities and resolve the factors 
and then do the same in personality 
means that the relation between the two 
sets of factors is unknown and they will 
inevitably overlap. We seek one research 
covering the whole of man, at least psy- 
chologically. This research kept as a unit 
and using multiple factor analysis should 
result in the establishment of a diagram 
such as we here indicate. 
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Third, we must validate tests in terms 
of these factors so that we have measures 
of single entities. Where we cannot get 
a measure of a single entity we can hold 
the one factor entering constant and as- 
sess the measurement of the other. Thus 
to measure v we can measure “‘g,” then 
measure “g’’ and v and then calculate the 
measurement of v. All tests at present in 
use can then be established as being meas- 
ures of these factors according to research 
in terms of them. The extent to which 
they measure various factors can easily be 
found, and as such composite measures 
they will prove very useful in many ways. 
For example the Bernreuter personality 
test may prove to be a measure of S, and 
S,, and as such we may have a definite 
place for it. Alternatively it may, with 
suitable alteration, be made a test of one 
of these. In point of fact all such tests 
should be included in the original re- 
search so that their placement in the 
scheme of things would be ascertained at 
the same time as the first task was being 
fulfilled. The point is that the criterion 
of what tests measure is in terms of in- 
ternal analysis, and then in terms of the 
factors we go to outside occupations and 
needs and find what combination of fac- 
tors they require. That, of course, is 
what we do now, only we use com posite 
traits instead of single factors. 

Beyond this lies the occupational anal- 
ysis in the terms thus defined. Here again 
there are very real problems as to pro- 
cedure but that is not for discussion here. 
The essential point in which we are con- 
cerned is that they must use the same 
terms as are being used in individual 
analysis. 

There is, of course, much research to 
be done in terms of individual differ- 
ences in the factors, age of maturity in 
them, and so on and so forth. That can 
all go on as soon as there are measures 
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of them which are satisfactory. Much in- 
formation in this sphere will be gained in 
the initial research. It must be said that 
in the work of the Differential Traits 
Committee such a research is under way, 
except that, as far as the writer is aware, 
the emphasis is almost wholly on abili- 
ties; personality, which is so vital in all 
guidance work, is largely omitted. Even 
so, the contribution that will come from 
the work of that committee must be very 
great and will go far to completing the 
diagram we are here suggesting. 

It is not a task that will ever reach 
completion because there must ever be 
changes in the needs of society. We can 
however, hold constant the terms in 
which we make analysis—and that is to 
me the most vital point of all. 
pational analysis we will inevitably find 
the needs changing with change of time 
and further advance in the technical 
sphere. We need therefore continuous 
research work to be carried on, but we 
can always use the same terms. An engi 
meer may need very different factor pat 
terns from those an engineer needed 
twenty years ago, but in both cases the 
needs can be described in the same terms 
These terms are psychological factors such 
as we here define. 

The work of guidance is a noble work 
It attempts to give to all the possibility 
of full self-realization. As such there is 
no more worthy service in any nation. 
The prospect of doing that work on a 
scientific basis, so that it would be highly 
accurate in its predictions, makes one al- 
most giddy with the possibilities of hap 
piness that are involved. To have no 
more square pegs in round holes, either 
in the matter of work or of living, is an 
ideal that should send us to our task with 
a will that must carry us on to success. 

We have done much already. We have 
made progress that is everywhere receiv- 


In occu- 
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ing favorable comment. This we have 
achieved with composite measures and 
lack of integration. What might we not 
achieve using single measures and with 
complete integration? 

It is in the belief that this theory opens 
up greater possibilities of greater success 
than we have yet achieved that it is pre- 
sented. It is not given out as something 
new so much as an integration of what 
has been there before. It is perhaps fair- 
est to describe it as a synthesis of ideas, 
ideas held by the writer when he arrived 
on these shores, ideas coming to him 
everywhere as he traveled in this most 
hospitable and generous country. 


APPENDIX 

In accordance with references made in 
the preceding paper we give in this ap- 
pendix an example of data analyzed by 
the statistical method outlined by Thur- 
stone in his “Multiple Factor Theory.” 

We do not propose to give the details 
of this analysis since this would involve 
considerable statistical information which 
has no place here. We give rather the 
results of the analysis to indicate what is 
revealed by such a procedure. We have 
selected this example because it uses 
measures with which the readers will be 
familiar. It should be made clear that 
the battery of tests used here is not nec- 
essarily a good battery for guidance. It 
is selected in this case to exhibit certain 
factors clearly, mot as a basis on which 
guidance is to be given. What would be 
a sound battery of tests for guidance is 
not under discussion in this appendix. 

We shall indicate the tests used in the 
first place, then indicate the results of the 
analysis in terms of correlation figures, 
and, finally, by means of discussion of a 
diagrammatic representation of these data, 
we shall endeavour to illustrate what is 
the procedure we suggest for the estab- 
lishment of the theory we have outlined. 


The following analysis was undertaken 
for the author by Professor Thurstone 
while the writer was in Chicago, and the 
interpretation of the analysis was made in 
the closest contact with Thurstone. Our 
thanks are due to him for his generosity 
in placing without restriction the facili- 
ties of his department at our disposal and 
for his unfailing courtesy at all times 
From the many discussions which we had 
with him our thinking in this sphere was 
cleared and informed as it had never been 
before. 

The following list of tests used in this 
investigation covers a broad sampling of 
tests in certain spheres. There is stress 
especially on those of performance testing 
of intelligence and verbal testing of inte! 
ligence. Here is the list: — 

1. The Stanford-Binet Individual Test 

2. Otis Group Scale for Intelligence 

3. Otis Self-administering Test of Inte! 
ligence 

4. Terman Group Test of Intelligence 

5. Thorndike Scale for Measuring Read 
ing Age 

6. Alexander Performance Scale for In 
telligence 

7. Pintner-Paterson Performance Scale 
for Intelligence 

8. Porteous Maze Test 

9. Healy Puzzle II, a Performance Test 
of Intelligence 


It is the fact that all these measures ar 
in use as measurements of intelligence 
and that on them guidance is based in 
different places. Some of them are indi- 
vidual in form, others are of group form 
Some are verbal in nature, some are prac- 
tical in nature. 

We gave these tests to a group of 80 
adults. This allows us to consider the 
data as coming from a constant age group, 
since all the evidence is that such meas- 
ures are independent of age at adult level. 

From the scores in these tests we can 
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calculate a table of intercorrelations. Hav- 
ing this table of correlations, we can ap- 
ply a process of multiple factor analysis 
to ascertain how many factors of an inde- 
pendent nature are involved, and further 
what the correlation is between each test 
and each factor. This we have done and 
we record below the correlations. 

We find there are two independent 
factors which we will call I and II respec 
tively. The correlations between each 
test and each factor are as follows. 


Test Factor Factor 
I II 
l 853 —.157 
2 850 -.274 
3 872 344 
4 889 480 
5 .737 .414 
6 .686 387 
7 645 403 
s 486 467 
9 .522 .259 


Our interpretation of these data is that 
Factor II really represents a difference be- 
tween two factors indicated by the nega- 
tive correlations and the positive, and for 
greater facility in explaining our purposes 
we propose to call the plus aspect of Fac- 
tor II as defined by the analysis Factor II, 
and call the negative aspect of that fac- 
tor in the analysis Factor III. We will 
represent the data graphically in two di- 
mensions, showing in the diagram the 
relation established by the analysis. (We 
would note here that this problem involv- 
ing the difference factors is one in which 
we have yet to reach agreement. Had we 
used a tetrad approach, as we are doing 
with certain other data, we would estab- 
lish the three factors as we wish to indi- 
cate them. That raises questions of the 
interpretation of such multiple factor 
processes which we leave meantime.*’) 


21 Since the above has been written we find that 
by rotation of axes this difficulty is completely 
overcome and that there is absolutely no difference 
between this set of results so obtained and that 
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Thus we will list anew the correlations 
produced by the analysis, this time calling 
the negative side of II, Factor III. This 
sets up two systems in this way 


SYSTEM 1 
Test Factor I Factor ll 
6 686 487 
7 645 403 
8 486 467 
9 522 259 
SYSTEM 2 
Test Factor I Factor Ill 
l R53 ] s‘*7 
2 850 274 
3 872 344 
4 889 480 
5 737 A414 


Now we may examine these results to 
ascertain what would be appropriate 
names for these factors 
positive correlations with every test in the 


Factor I has 


battery and these are all above the value 
.5. That is to say they rank as high cor- 
relations. This factor is the general fac 

tor of the battery. Now that does not 
mean that it is a true “g.”” We should 
have included in the battery tests of the 
perceptual nature indicated earlier, and 
these would have been held as measures 
of true "g.” We are satisfied, however, 
that had we used such tests in this case 
the “g’”’ factor would have had substan 

tially the same results as this general fac 

tor. This has come from examination of 
other data in which such tests were used. 
Meantime let us realize that we should 
have used such perceptual tests and lo- 
cated the “g’’ axis in the centroid of such 
a system. Assuming that this had been 
done, Factor I would properly be called 
""g.” As it is, we will call it the general 
factor (adding, of this system, to be quite 
accurate ). 

obtained from tetrad analysis. We find these data 
are to be explained in terms of “g,” “v,” and P— 
all three being independent factors as indicated in 
the text of this paper. This analysis complete and 


with axes rotated is at present in course of prep- 
aration for publication. 








OCCUPATIONS 


Let us look at Factor III next as being 
most interesting and instructive as to pro- 
cedure in naming factors. Factor III has 
correlation varying from .157 to .414 
with five different tests. The test hav- 
ing this factor to least extent among the 
five, is test 1, the Stanford Binet. Tests 
2, 3, and 4 have Factor III in almost the 
same amounts and that somewhat higher 
than test 1, while test 5 is highest in 
terms of Factor III. Now we know that 
the Stanford Binet is less verbal than the 
three verbal Group scales, while they in 
turn are not quite so purely verbal as 
Thorndike Reading Age. That being so, 
it would appear that Factor III increases 
as verbality of test increases. From such 
reasoning we decide with excellent 
grounds to call Factor III the Verbal fac- 
tor, indicated in our diagram by »v. 

Factor II shows itself as belonging to 
tests 6, 7, 8 and 9. These are all prac- 
tical tests, or performance tests. In view 
of a similar examination of the nature of 
the tests we call it the practical factor and 
represent it in our diagram by P. 

Now we can represent these results 
rather advantageously in a diagram as 
shown below. 


DIAGRAM SHOWING RESULTS OF 
MULTIPLE FACTOR ANALYSIS IN NINE 
VARIABLES WITH 80 ADULT CASES 


P (Practical Factor) 






Practical 
4 - 





§ Ability 
ye 
-o9 
-,~/general 
or 7 factor 
£8 


Verbal 
Ability 





V (Verbal Factor) 


Tests as Shown 
. Stanford Binet 
. Otis Group Test (Verbal) 
Otis S. A. Test (Verbal) 
. Terman Group Test (Verbal) 
. Thorndike Reading Test (Verbal) 

6. Alexander Scale (Performance) 

7. Pintner-Paterson Scale (Performance) 

8. Porteous Maze Test 

9. Healy Puzzle II (Performance) 

Note:—The circle represents correlatior 
of unity along any radius. Thus, for exampk 
the Stanford Binet is placed as shown having 
correlations or loading of “g”’ of amount 
£835 and with v of amount .157. All the tests 
are thus placed on the diagram according to 
their correlation with the factors, a wholly 
objective process. 

It may be noted that the reliability of any 
test is measured by its distance from th: 
origin. (Note unreliability of tests 8 and 
relatively.) 

The diagram shows along each axis the 
correlation of each test. Thus test 1 is 
marked in the diagram as it is because 
it has .853 of I and .157 of III. And so 
on with each test. The diagram shows 
two distinct clusters of tests indicating the 
presence of two functional abilities and 
these are marked at points X and Y. This 
illustrates what we mean when we speak 
of functional ability as being a combina- 
tion of two factors. Verbal ability in this 
case we have taken as the centroid of the 
system of tests falling in Quadrant I, III 
Practical ability we show as a combina 
tion of “g’’ and P in Quadrant I, II. 

If we had used perceptual tests which 
are a true measure of “‘g’’ we should then 
have placed the “g” axis through the 
centroid of the perceptual system, thus 
uniquely determining the other two axes 

Notice that Practical Ability is not in- 
dependent of Verbal Ability. In fact they 
have according to this result a correlation 
of .59. That is easily understood when we 
see that both of them have “‘g”’ in large 
amount in common. That is where they 
are the same. Their difference lies in the 
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A THEORETICAL BASIS FOR RESEARCH 


fact that to “g,’’ practical ability needs 
the addition of P, while verbal ability 
needs the addition of v. The relationship 
of functional abilities to psychological 
factors is thus illustrated. This brief ap- 
pendix must not be taken as in any way 


an attempt to substantiate the theory we 
have presented in the preceding pages. It 
is the merest illustration of the type of 
approach which seems to illustrate to best 
purpose what we have been advocating 
as a sound theory. 
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grees of B.S., and M.A., from the University 
of Glasgow in 1928; the degree of C.T., 
from the Training College at Glasgow in 
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ANNOUNCEMENT OF MAY ISSUE 


As this number of the magazine is devoted exclusively to the symposium 
on “Analysis of the Individual,” the regular departments are omitted 
In May the report of the Cleveland convention and the news of the 
NVGA branches will be featured. 


~NEW WAYS 
TO 
EARN A LIVING 


IN VOCATIONS REQUIRING LITTLE 
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This book tells how men and women with imagination have a \ 
created new vocations for themselves that earn them a living in \ 
these difficult days. Their actual experiences are given (with % 


full instructions) in a non-technical, conversational style, sure 
to inspire self confidence and awaken initiative. Money back if 


not satisfied. 
MAKE YOUR OWN JOB | 


118 Opportunities in Unusual Vocations 
By Viotet Ryver and H. B. Doust 


216 pp., cloth Postpaid $2 
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OCCUPATIONS 





The outstanding 
occupational civics text 


for junior high schools 
revised to include data 
on NRA requirements 


his revision makes use of the latest census 
data in its occupational information. It takes 
account of conditions brought about by the eco- 
nomic crisis which began in 1929. It includes 
new information on the effect of NRA and other 
recent legislation on hours of labor, minimum 
wages, and other code requirements, covering 


all of the occupations described in the book 


PLANNING 
YOUR FUTURE 

By Grorce E. Myers 
Professor of Vocational Guidance, University of 


Michigan 


Giapys M, LITTLe 
Assistant Principal, Cleveland Intermediate 
School, Detroit 


and SarAuH A. Rosinson 
Girls’ Counselor, Hutchins Intermediate School, 
Detroit 
SECOND EDITION 
419 pages, 544 x 8, illustrated, $1.50 


Here is a text by three experienced teachers 
who purpose to help the pupil of junior high 
school age to think out an intelligent and practi 
cal answer to his own question—What am | 
going to be when I grow up? It answers gen- 
eral questions, studies the major wage-earning 
groups of occupations, presents a few simple but 
fundamental principles of economics and dis- 
cusses the place of the school in vocational 
planning. 


The book is divided into four main sections: 


1. Our World of Occupations 

2. Occupations in Your Community 
3. Facts Every Worker Should Know 
4. Finding Your Place 


Send for a copy on approval 
McGRAW-HILL BOOK CO., Inc. 


330 West 42nd Street 
New York, N. Y. 

















HANDBOOK OF | 
ADULT EDUCATION | 


In The United States 
’ 


The first attempt to survey the 
whole field of adult education in 
the United States. 


Partial Table of Contents 
Vocational Education for Adults— 
Vocational Guidance of Adults—Vo- 
cational Rehabilitation of Physically 
Handicapped Adults—Education for 
the Unemployed—Libraries and Adult 
Education — Alumni Education — 
Workers’ Education—Special Schools 
for Adults—Agricultural Extension— 
Adult Education and the Foreign 
Born—Adult Education for Negroes 
—Lyceums and Chautauquas—Recre- 
ation for Adults—The Arts in Adult 
Education — Community and State 
Organizations of Adult Education 
Agencies — University Extension — 
Parent Education 


$1.50 to members of the Association 
$2.00 to others 


American Association for Adult 
Education 
60 East Forty-Second Street 
NEW YORK 
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STATEMENT OF PURPOSES 





| THE PURPOSES AND ACTIVITIES OF THE 
NATIONAL OCCUPATIONAL CONFERENCE 


a 
{ 
The National Occupational Conference is interested in all aspects of occupa 
tional adjustment, and in cooperative efforts to study this problem. At present it 
} 


| is concerned primarily with assembling information about occupations, and making 
| such information available to the public through effective publication. It seeks to 
| encourage research in fields where adequate information is not available at presen 
| and maintains at headquarters an index of published information on all occupations 


The Conference also provides, for educational institutions, libraries, and other 


interested organizations, a consulting service regarding the theory and pra 
|: vocational guidance, and the results of research in occupational adjustment. N 
| charge is made for any assistance which can be given by mail. Upon request, a sta 
| officer of the Conference will visit local institutions for consultation regarding th 
organization of work designed to contribute to the better occupational adjustment 
of more than one person. The Conference will contribute the services of staff 
officers for such trips, but will expect local institutions to defray the necessary ex 
penses. The work of the Conference does not include counseling with individuals 


regarding their personal occupational problems. 


++ 








The National Occupational Conference is administered through the American 
Association for Adult Education. 
\ NATIONAL OCCUPATIONAL CONFERENCI 
522 Fifth Avenue, New York 
| The 
| Vocational Guidance Magazine 
J 
The Vocational Guidance Magazine, for eighteen years the official organ of th 
National Vocational Guidance Association, has taken one more forward step in it 
steady development and appears now in enlarged size under the name: Occupations, th 
Vocational Guidance Magazine. It continues its official relation to the National Associa 


tion and at the same time becomes the medium for disseminating guidance and occupa 


tional information resulting from the work of the National Occupational Confere: 


This periodical is to contain ninety-six pages, adequately illustrated, and issued nine 
times a year, October to June. The subject matter is designed to appeal to those 
| terested in all phases of guidance in school, industry, business, social agencies, and 
service clubs. Occupational adjustment of both youth and adult will be presented 
through articles specially prepared by outstanding persons 
Frep C. Smits, Eprror 
OCCUPATIONS, rae Vocationat GUIDANCE MAGAZINE 
25 Lawrence Hatt, Harvarp UNIVERSITY 
| CAMBRIDGE, MASSACHUSETTS 
Please enter my subscription to Occupations, the Vocational uidance Magazine t $ " 
() I wish to become a member of the National Vocational Guidance Asso n at $ 
which includes a year’s subscription to Occupations, the b ocational Guidance 1gacin 


Please inform me as to the nearest Local Vocational Guidance Branch Ass 


(1) Please send me a free sample copy of Occupations, the Vocational Guidance 
address below 


Name 
Address 


Date 
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